Apr 24 19:07:51 devstack cinder-volume[71887]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:07:51 devstack cinder-volume[71887]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:07:51 devstack cinder-volume[71887]: we strongly recommend against using it for new projects. Apr 24 19:07:51 devstack cinder-volume[71887]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:07:51 devstack cinder-volume[71887]: framework. For more detail see Apr 24 19:07:51 devstack cinder-volume[71887]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:07:51 devstack cinder-volume[71887]: import eventlet # noqa Apr 24 19:07:53 devstack cinder-volume[71887]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=71887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:07:53 devstack cinder-volume[71887]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=71887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:07:53 devstack cinder-volume[71887]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=71887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:07:54 devstack cinder-volume[71887]: INFO dbcounter [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Registered counter for database cinder Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_db.sqlalchemy.engines [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG dbcounter [-] [71887] Writer thread running {{(pid=71887) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:07:54 devstack cinder-volume[71887]: INFO cinder.rpc [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:07:54 devstack cinder-volume[71887]: INFO cinder.rpc [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_db.sqlalchemy.engines [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:07:54 devstack cinder-volume[71887]: INFO cinder.volume.manager [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Determined volume DB was empty at startup. Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG cinder.volume.manager [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=71887) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:07:54 devstack cinder-volume[71887]: INFO cinder.volume.manager [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 19:07:54 devstack cinder-volume[71887]: WARNING stevedore.named [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:07:54 devstack cinder-volume[71887]: WARNING castellan.key_manager [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:07:54 devstack cinder-volume[71887]: WARNING cinder.keymgr.conf_key_mgr [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG cinder.volume.drivers.lvm [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=71887) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_concurrency.processutils [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=71887) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_concurrency.processutils [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] CMD "cinder-rtstool verify" returned: 0 in 0.242s {{(pid=71887) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_db.sqlalchemy.engines [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:07:54 devstack cinder-volume[71887]: INFO cinder.rpc [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 24 19:07:54 devstack cinder-volume[71887]: INFO cinder.rpc [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 24 19:07:54 devstack cinder-volume[71887]: WARNING stevedore.named [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:07:54 devstack cinder-volume[71887]: WARNING castellan.key_manager [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:07:54 devstack cinder-volume[71887]: INFO cinder.volume.manager [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_db.sqlalchemy.engines [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:07:54 devstack cinder-volume[71887]: INFO oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Starting 1 workers Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Started child 71994 {{(pid=71887) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Full set of CONF: {{(pid=71887) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] ******************************************************************************** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Configuration options gathered from: {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] ================================================================================ {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:07:54 devstack cinder-volume[71994]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] allow_availability_zone_fallback = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] allow_compression_on_image_upload = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] allowed_direct_url_schemes = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] api_rate_limit = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] auth_strategy = keystone {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] az_cache_duration = 3600 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_availability_zone = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_host = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_stats_polling_interval = 60 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backup_api_class = cinder.backup.api.API {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backup_name_template = backup-%s {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backup_use_same_host = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backup_use_temp_snapshot = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] chap_password = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] chap_username = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cinder_internal_tenant_project_id = 664f9cdd82864bad9800ae08e92112b9 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cinder_internal_tenant_user_id = d9c2e0f88c8749e5896f093c10f9fec3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cloned_volume_same_az = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cluster = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] compression_format = gzip {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] compute_api_class = cinder.compute.nova.API {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] config_dir = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] config_source = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] control_exchange = openstack {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] debug = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] default_availability_zone = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] default_group_type = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] default_volume_type = lvmdriver-1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] disk_geometry = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] driver_client_cert = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] driver_client_cert_key = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] driver_data_namespace = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] driver_ssl_cert_path = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] driver_ssl_cert_verify = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] driver_use_ssl = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] enable_force_upload = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] enable_new_services = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] enable_unsupported_driver = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] enabled_backends = ['lvmdriver-1'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] enforce_multipath_for_image_xfer = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] filter_function = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_api_insecure = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_api_servers = ['http://192.168.122.95/image'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_api_ssl_compression = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_ca_certificates_file = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_catalog_info = image:glance:publicURL {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_certfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_keyfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_num_retries = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance_request_timeout = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] goodness_function = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] graceful_shutdown_timeout = 5 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] group_api_class = cinder.group.api.API {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] host = devstack {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_compress_on_upload = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_conversion_address_space_limit = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_conversion_cpu_limit = 60 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_conversion_disable = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_upload_use_cinder_backend = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_upload_use_internal_tenant = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_volume_cache_enabled = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_volume_cache_max_count = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] image_volume_cache_max_size_gb = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] init_host_max_objects_retrieval = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] instance_format = [instance: %(uuid)s] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] iscsi_target_flags = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] iscsi_write_cache = on {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] iser_helper = tgtadm {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] iser_ip_address = 192.168.122.95 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] iser_port = 3260 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] log_color = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] log_config_append = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] log_dir = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] log_file = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] log_options = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] log_rotate_interval = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] log_rotate_interval_type = days {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] log_rotation_type = none {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] max_age = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] max_logfile_count = 30 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] max_logfile_size_mb = 200 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71994]: INFO cinder.volume.manager [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] max_over_subscription_ratio = 20.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] message_reap_interval = 86400 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] message_ttl = 2592000 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] migration_create_volume_timeout_secs = 300 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] monkey_patch = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] monkey_patch_modules = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] my_ip = 192.168.122.95 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] no_snapshot_gb_quota = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] num_iser_scan_tries = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] num_shell_tries = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] num_volume_device_scan_tries = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] nvmeof_conn_info_version = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] nvmet_ns_id = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] nvmet_port_id = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] osapi_max_limit = 1000 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] osapi_volume_ext_list = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] osapi_volume_listen = 0.0.0.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] osapi_volume_listen_port = 8776 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] osapi_volume_use_ssl = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] osapi_volume_workers = 2 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] per_volume_size_limit = -1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] periodic_fuzzy_delay = 60 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] periodic_interval = 60 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] project_id_regex = [0-9a-f\-]+ {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] public_endpoint = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] publish_errors = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] quota_backup_gigabytes = 1000 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] quota_backups = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] quota_gigabytes = 1000 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] quota_groups = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] quota_snapshots = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] quota_volumes = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] rate_limit_burst = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] rate_limit_except_level = CRITICAL {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] rate_limit_interval = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] reinit_driver_count = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] replication_device = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] report_discard_supported = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] report_interval = 120 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] reservation_clean_interval = 86400 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] reservation_expire = 86400 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] reserved_image_namespaces = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] reserved_percentage = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] rpc_response_timeout = 120 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] run_external_periodic_tasks = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] scst_target_driver = iscsi {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] scst_target_iqn_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_down_time = 720 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] shell_completion = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] snapshot_name_template = snapshot-%s {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] snapshot_same_host = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] split_loggers = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] state_path = /opt/stack/data/cinder {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] storage_availability_zone = nova {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] storage_protocol = iSCSI {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] syslog_log_facility = LOG_USER {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] target_helper = lioadm {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] target_ip_address = 192.168.122.95 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] target_port = 3260 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] target_protocol = iscsi {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] target_secondary_ip_addresses = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] trace_flags = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] transfer_api_class = cinder.transfer.api.API {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] transport_url = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] until_refresh = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] use_chap_auth = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] use_default_quota_class = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] use_journal = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] use_json = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] use_multipath_for_image_xfer = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] use_stderr = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] use_syslog = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] verify_glance_signatures = enabled {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_api_class = cinder.volume.api.API {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_backend_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_clear = zero {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_clear_ionice = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_clear_size = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_copy_bps_limit = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_dd_blocksize = 1M {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_name_template = volume-%s {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_service_inithost_offload = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volume_usage_audit_period = month {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] zoning_mode = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_concurrency.disable_process_locking = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.admin_password = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.admin_token = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.admin_user = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.auth_admin_prefix = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.auth_port = 35357 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.auth_protocol = https {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.auth_section = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.auth_type = password {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.auth_uri = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.auth_version = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.cache = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.certfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.delay_auth_decision = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.http_connect_timeout = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.identity_uri = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.include_service_catalog = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.insecure = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.interface = public {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.keyfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_password = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcache_username = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.region_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.service_token_roles_required = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.service_type = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.token_cache_time = 300 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.backend = dogpile.cache.null {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.backend_argument = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.backend_expiration_time = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.config_prefix = cache.oslo {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.debug_cache_backend = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.enable_retry_client = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.enable_socket_keepalive = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.enabled = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.enforce_fips_mode = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.expiration_time = 600 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.hashclient_retry_attempts = 2 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.memcache_dead_retry = 300 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.memcache_pool_maxsize = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.memcache_sasl_enabled = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.password = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.proxies = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.redis_db = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.redis_sentinel_service_name = mymaster {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.redis_server = localhost:6379 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.retry_attempts = 2 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.retry_delay = 0.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.socket_keepalive_count = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.socket_keepalive_idle = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.socket_keepalive_interval = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.socket_timeout = 1.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.tls_allowed_ciphers = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.tls_cafile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.tls_certfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.tls_enabled = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.tls_keyfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cache.username = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] coordination.backend_url = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.asyncio_connection = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.asyncio_slave_connection = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.backend = sqlalchemy {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.connection = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.connection_debug = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.connection_parameters = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.connection_recycle_time = 3600 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.connection_trace = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.db_inc_retry_interval = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.db_max_retries = 20 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.db_max_retry_interval = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.db_retry_interval = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.max_overflow = 50 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.max_pool_size = 5 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.max_retries = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.mysql_wsrep_sync_wait = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.pool_timeout = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.retry_interval = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.slave_connection = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.sqlite_synchronous = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.synchronous_reader = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] database.use_db_reconnect = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.connection_string = messaging:// {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.enabled = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.es_doc_type = notification {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.es_scroll_size = 10000 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.es_scroll_time = 2m {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.filter_error_trace = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.hmac_keys = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.sentinel_service_name = mymaster {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.socket_timeout = 0.1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.trace_requests = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler.trace_sqlalchemy = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler_jaeger.process_tags = {} {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler_jaeger.service_name_prefix = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] profiler_otlp.service_name_prefix = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.enforce_new_defaults = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: WARNING oslo_config.cfg [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.enforce_scope = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.policy_default_rule = default {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.policy_file = policy.yaml {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_policy.remote_timeout = 60.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] privsep_osbrick.group = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] privsep_osbrick.helper_command = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] privsep_osbrick.user = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cinder_sys_admin.group = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cinder_sys_admin.helper_command = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] cinder_sys_admin.user = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.auth_section = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.auth_type = password {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.cafile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.certfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.collect_timing = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.insecure = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.keyfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.send_service_user_token = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.split_loggers = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] service_user.timeout = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.auth_section = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.auth_type = password {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.certfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.collect_timing = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.insecure = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.keyfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.region_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.split_loggers = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] glance.timeout = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.backend_availability_zone = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.chap_password = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.chap_username = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.disk_geometry = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.driver_client_cert = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.driver_client_cert_key = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.driver_data_namespace = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.driver_use_ssl = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.enable_unsupported_driver = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.extra_capabilities = {} {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.filter_function = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.goodness_function = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.iscsi_target_flags = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.iscsi_write_cache = on {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.iser_helper = tgtadm {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.iser_port = 3260 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.lvm_mirrors = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.lvm_share_target = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.lvm_type = auto {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.num_shell_tries = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.nvmet_port_id = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.replication_device = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.report_discard_supported = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.reserved_percentage = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.scst_target_driver = iscsi {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.scst_target_iqn_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.storage_protocol = iSCSI {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.target_helper = tgtadm {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.target_port = 3260 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.target_protocol = iscsi {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.trace_flags = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.unique_fqdn_network = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.use_chap_auth = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volume_backend_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volume_clear = zero {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volume_clear_ionice = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volume_clear_size = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volume_group = cinder-volumes {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_reports.file_event_handler = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_reports.log_dir = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.backend_availability_zone = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.backend_host = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.chap_password = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.chap_username = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.chiscsi_conf = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.disk_geometry = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.driver_client_cert = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.driver_data_namespace = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.driver_use_ssl = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.extra_capabilities = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.filter_function = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.goodness_function = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.iser_helper = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.iser_ip_address = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.iser_port = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.iser_target_prefix = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.lvm_conf_file = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.lvm_mirrors = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.lvm_share_target = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.lvm_type = auto {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.num_shell_tries = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.nvmet_port_id = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.replication_device = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.report_discard_supported = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.reserved_percentage = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.scst_target_driver = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.storage_protocol = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.target_helper = lioadm {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.target_ip_address = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.target_port = 3260 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.target_protocol = iscsi {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.trace_flags = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.use_chap_auth = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack sudo[71998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 24 19:07:54 devstack sudo[71998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volume_clear = zero {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volume_clear_size = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] lvmdriver-1.volumes_dir = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.ssl = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.ssl_version = {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_notifications.driver = [] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_notifications.retry = -1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] key_manager.fixed_key = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.barbican_api_version = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.barbican_endpoint = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.barbican_endpoint_type = public {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.barbican_region_name = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.cafile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.certfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.collect_timing = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.insecure = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.keyfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.number_of_retries = 60 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.retry_delay = 1 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.send_service_user_token = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.split_loggers = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.timeout = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.verify_ssl = True {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican.verify_ssl_path = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican_service_user.auth_section = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican_service_user.auth_type = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican_service_user.cafile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican_service_user.certfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican_service_user.collect_timing = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican_service_user.insecure = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican_service_user.keyfile = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican_service_user.split_loggers = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] barbican_service_user.timeout = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.approle_role_id = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.approle_secret_id = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.kv_mountpoint = secret {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.kv_path = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.kv_version = 2 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.namespace = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.root_token_id = **** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.ssl_ca_crt_file = None {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.timeout = 60.0 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.use_ssl = False {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:07:54 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] ******************************************************************************** {{(pid=71887) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:07:55 devstack sudo[71998]: pam_unix(sudo:session): session closed for user root Apr 24 19:07:55 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:55 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:55 devstack sudo[72304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:07:55 devstack sudo[72304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:07:55 devstack sudo[72304]: pam_unix(sudo:session): session closed for user root Apr 24 19:07:56 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.557s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:56 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:07:56 devstack cinder-volume[71994]: INFO cinder.brick.local_dev.lvm [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 24 19:07:56 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:56 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:56 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:56 devstack sudo[72502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:07:56 devstack sudo[72502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:07:56 devstack sudo[72502]: pam_unix(sudo:session): session closed for user root Apr 24 19:07:56 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:56 devstack cinder-volume[71994]: DEBUG cinder.brick.local_dev.lvm [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=71994) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 24 19:07:56 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:56 devstack sudo[72550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:07:56 devstack sudo[72550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:07:57 devstack sudo[72550]: pam_unix(sudo:session): session closed for user root Apr 24 19:07:57 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.840s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:57 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:57 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:57 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:57 devstack sudo[72685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:07:57 devstack sudo[72685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:07:58 devstack sudo[72685]: pam_unix(sudo:session): session closed for user root Apr 24 19:07:58 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:58 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:58 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:58 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:58 devstack sudo[72689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 24 19:07:58 devstack sudo[72689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:07:58 devstack sudo[72689]: pam_unix(sudo:session): session closed for user root Apr 24 19:07:58 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.461s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:58 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:58 devstack sudo[72693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:07:58 devstack sudo[72693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:07:59 devstack sudo[72693]: pam_unix(sudo:session): session closed for user root Apr 24 19:07:59 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:59 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:59 devstack sudo[72697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:07:59 devstack sudo[72697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:07:59 devstack sudo[72697]: pam_unix(sudo:session): session closed for user root Apr 24 19:07:59 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:07:59 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:07:59 devstack sudo[72704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:07:59 devstack sudo[72704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:00 devstack sudo[72704]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:00 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:00 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:00 devstack sudo[72708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:08:00 devstack sudo[72708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:00 devstack sudo[72708]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:00 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:00 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:00 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:00 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:00 devstack sudo[72712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:08:00 devstack sudo[72712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:01 devstack sudo[72712]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:01 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:01 devstack cinder-volume[71994]: INFO cinder.volume.drivers.lvm [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 24 19:08:01 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:01 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:01 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:01 devstack sudo[72816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:08:01 devstack sudo[72816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:01 devstack sudo[72816]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:01 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:01 devstack cinder-volume[71994]: DEBUG cinder.volume.drivers.lvm [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Updating volume stats {{(pid=71994) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:08:01 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:01 devstack sudo[72836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:08:01 devstack sudo[72836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:02 devstack sudo[72836]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:02 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.564s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:02 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:02 devstack sudo[72977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:02 devstack sudo[72977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:02 devstack sudo[72977]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:02 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:02 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:02 devstack sudo[73015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:08:02 devstack sudo[73015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:03 devstack sudo[73015]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:03 devstack sudo[73018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:03 devstack sudo[73018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:03 devstack sudo[73018]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:03 devstack cinder-volume[71994]: INFO cinder.volume.driver [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG cinder.volume.driver [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=71994) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG oslo_db.sqlalchemy.engines [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71994) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG dbcounter [-] [71994] Writer thread running {{(pid=71994) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG cinder.db.sqlalchemy.api [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Building query based on filter {{(pid=71994) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG cinder.image.image_utils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=71994) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:08:03 devstack cinder-volume[71994]: INFO cinder.keymgr.migration [None req-74ee5c6d-87ef-477d-a741-927b0825a223 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG cinder.volume.drivers.lvm [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Updating volume stats {{(pid=71994) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:08:03 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:03 devstack sudo[73025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:08:03 devstack sudo[73025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:04 devstack sudo[73025]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:04 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:04 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:04 devstack sudo[73029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:04 devstack sudo[73029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:04 devstack cinder-volume[71887]: DEBUG dbcounter [-] [71887] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71887) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:08:04 devstack sudo[73029]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:04 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:04 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:04 devstack sudo[73034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:08:04 devstack sudo[73034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:05 devstack sudo[73034]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:05 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.512s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:05 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:05 devstack sudo[73038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:05 devstack sudo[73038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:05 devstack sudo[73038]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:05 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:05 devstack cinder-volume[71994]: DEBUG cinder.manager [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Notifying Schedulers of capabilities ... {{(pid=71994) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:08:05 devstack cinder-volume[71994]: INFO cinder.volume.manager [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Driver initialization completed successfully. Apr 24 19:08:05 devstack cinder-volume[71994]: INFO cinder.manager [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Initiating service 2 cleanup Apr 24 19:08:05 devstack cinder-volume[71994]: INFO cinder.manager [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Service 2 cleanup completed. Apr 24 19:08:05 devstack cinder-volume[71994]: DEBUG cinder.service [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Creating RPC server for service cinder-volume {{(pid=71994) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:08:05 devstack cinder-volume[71994]: DEBUG cinder.service [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=71994) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:08:05 devstack cinder-volume[71994]: INFO cinder.volume.manager [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 24 19:08:05 devstack cinder-volume[71994]: DEBUG cinder.volume.drivers.lvm [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Updating volume stats {{(pid=71994) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:08:05 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:05 devstack sudo[73044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:08:05 devstack sudo[73044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:06 devstack sudo[73044]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:06 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.522s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:06 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:06 devstack sudo[73048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:06 devstack sudo[73048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:06 devstack sudo[73048]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:06 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:06 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:06 devstack sudo[73051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:08:06 devstack sudo[73051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:07 devstack sudo[73051]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:07 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.500s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:07 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:07 devstack sudo[73109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:07 devstack sudo[73109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:07 devstack sudo[73109]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:07 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:07 devstack cinder-volume[71994]: INFO cinder.volume.manager [None req-5d4c2f39-d4fc-44db-8507-0c296053ad6d None None] Driver post RPC initialization completed successfully. Apr 24 19:08:17 devstack cinder-volume[71994]: DEBUG dbcounter [-] [71994] Writing DB stats cinder:SELECT=3 {{(pid=71994) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:08:17 devstack cinder-volume[71994]: DEBUG dbcounter [-] [71994] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=71994) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:08:53 devstack cinder-volume[71994]: DEBUG oslo_service.periodic_task [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:08:53 devstack cinder-volume[71994]: DEBUG cinder.volume.drivers.lvm [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Updating volume stats {{(pid=71994) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:08:53 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:53 devstack sudo[75299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:08:53 devstack sudo[75299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:54 devstack sudo[75299]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:54 devstack sudo[75302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:54 devstack sudo[75302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:54 devstack sudo[75302]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:54 devstack sudo[75305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:08:54 devstack sudo[75305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:55 devstack sudo[75305]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:55 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.503s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:55 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:55 devstack sudo[75308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:55 devstack sudo[75308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:55 devstack sudo[75308]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:55 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:55 devstack cinder-volume[71994]: DEBUG cinder.manager [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Notifying Schedulers of capabilities ... {{(pid=71994) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:09:53 devstack cinder-volume[71994]: DEBUG oslo_service.periodic_task [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:09:53 devstack cinder-volume[71994]: DEBUG cinder.volume.drivers.lvm [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Updating volume stats {{(pid=71994) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:09:53 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:54 devstack sudo[78117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:09:54 devstack sudo[78117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:54 devstack sudo[78117]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.515s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:54 devstack sudo[78120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:54 devstack sudo[78120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:54 devstack sudo[78120]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:54 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:54 devstack sudo[78123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:54 devstack sudo[78123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:55 devstack sudo[78123]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:55 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:55 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:55 devstack sudo[78126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:55 devstack sudo[78126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:55 devstack sudo[78126]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:55 devstack cinder-volume[71994]: DEBUG oslo_concurrency.processutils [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=71994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:55 devstack cinder-volume[71994]: DEBUG cinder.manager [None req-0603a313-2544-464e-918f-7a9be09eba82 None None] Notifying Schedulers of capabilities ... {{(pid=71994) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:10:17 devstack cinder-volume[71994]: DEBUG dbcounter [-] [71994] Writing DB stats cinder:SELECT=1 {{(pid=71994) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:10:17 devstack cinder-volume[71994]: DEBUG dbcounter [-] [71994] Writing DB stats cinder:UPDATE=1 {{(pid=71994) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:11:36 devstack cinder-volume[71887]: INFO oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Caught SIGTERM, stopping children Apr 24 19:11:36 devstack cinder-volume[71887]: DEBUG oslo_concurrency.lockutils [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Acquiring lock "singleton_lock" {{(pid=71887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:11:36 devstack cinder-volume[71887]: DEBUG oslo_concurrency.lockutils [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Acquired lock "singleton_lock" {{(pid=71887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:11:36 devstack cinder-volume[71887]: DEBUG oslo_concurrency.lockutils [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Releasing lock "singleton_lock" {{(pid=71887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:11:36 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Stop services. {{(pid=71887) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 19:11:36 devstack cinder-volume[71887]: DEBUG oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Killing children. {{(pid=71887) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 19:11:36 devstack cinder-volume[71887]: INFO oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Waiting on 1 children to exit Apr 24 19:11:40 devstack cinder-volume[71994]: DEBUG oslo_concurrency.lockutils [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Acquiring lock "singleton_lock" {{(pid=71994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:11:40 devstack cinder-volume[71994]: DEBUG oslo_concurrency.lockutils [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Acquired lock "singleton_lock" {{(pid=71994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:11:40 devstack cinder-volume[71994]: DEBUG oslo_concurrency.lockutils [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Releasing lock "singleton_lock" {{(pid=71994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:11:40 devstack cinder-volume[71994]: WARNING amqp [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:11:40 devstack cinder-volume[71994]: WARNING amqp [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:11:40 devstack cinder-volume[71887]: INFO oslo_service.backend._eventlet.service [None req-c50c4ac7-f7b4-43ac-8998-f6fc36fd1f77 None None] Child 71994 exited with status 0 Apr 24 19:11:41 devstack cinder-volume[80952]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:11:41 devstack cinder-volume[80952]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:11:41 devstack cinder-volume[80952]: we strongly recommend against using it for new projects. Apr 24 19:11:41 devstack cinder-volume[80952]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:11:41 devstack cinder-volume[80952]: framework. For more detail see Apr 24 19:11:41 devstack cinder-volume[80952]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:11:41 devstack cinder-volume[80952]: import eventlet # noqa Apr 24 19:11:43 devstack cinder-volume[80952]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80952) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:11:43 devstack cinder-volume[80952]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80952) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:11:43 devstack cinder-volume[80952]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80952) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:11:44 devstack cinder-volume[80952]: INFO dbcounter [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Registered counter for database cinder Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_db.sqlalchemy.engines [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80952) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG dbcounter [-] [80952] Writer thread running {{(pid=80952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:11:44 devstack cinder-volume[80952]: INFO cinder.rpc [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:11:44 devstack cinder-volume[80952]: INFO cinder.rpc [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_db.sqlalchemy.engines [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80952) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:11:44 devstack cinder-volume[80952]: INFO cinder.volume.manager [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Determined volume DB was empty at startup. Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG cinder.volume.manager [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80952) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:11:44 devstack cinder-volume[80952]: INFO cinder.volume.manager [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 19:11:44 devstack cinder-volume[80952]: WARNING stevedore.named [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:11:44 devstack cinder-volume[80952]: WARNING castellan.key_manager [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:11:44 devstack cinder-volume[80952]: WARNING cinder.keymgr.conf_key_mgr [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:11:44 devstack cinder-volume[80952]: INFO cinder.volume.manager [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_db.sqlalchemy.engines [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80952) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:11:44 devstack cinder-volume[80952]: INFO oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Starting 1 workers Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Started child 81071 {{(pid=80952) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Full set of CONF: {{(pid=80952) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] ******************************************************************************** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Configuration options gathered from: {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:11:44 devstack cinder-volume[81071]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] ================================================================================ {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] allow_availability_zone_fallback = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] allow_compression_on_image_upload = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] allowed_direct_url_schemes = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] api_rate_limit = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] auth_strategy = keystone {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_availability_zone = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_host = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_stats_polling_interval = 60 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backup_api_class = cinder.backup.api.API {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backup_name_template = backup-%s {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backup_use_same_host = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backup_use_temp_snapshot = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] chap_password = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] chap_username = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cinder_internal_tenant_project_id = 664f9cdd82864bad9800ae08e92112b9 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cinder_internal_tenant_user_id = d9c2e0f88c8749e5896f093c10f9fec3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cluster = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] compression_format = gzip {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] compute_api_class = cinder.compute.nova.API {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] config_dir = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] config_source = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] control_exchange = openstack {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] debug = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] default_availability_zone = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] default_group_type = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] default_volume_type = QuobyteHD {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] disk_geometry = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] driver_client_cert = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] driver_client_cert_key = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] driver_data_namespace = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] driver_ssl_cert_path = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] driver_ssl_cert_verify = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] driver_use_ssl = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] enable_new_services = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] enable_unsupported_driver = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] enabled_backends = ['QuobyteHD'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] enforce_multipath_for_image_xfer = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] filter_function = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_api_insecure = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_api_servers = ['http://192.168.122.95/image'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_api_ssl_compression = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_ca_certificates_file = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_catalog_info = image:glance:publicURL {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_certfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_keyfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_num_retries = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance_request_timeout = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] goodness_function = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] graceful_shutdown_timeout = 5 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] group_api_class = cinder.group.api.API {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] host = devstack {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_compress_on_upload = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_conversion_address_space_limit = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_conversion_cpu_limit = 60 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_conversion_disable = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_upload_use_cinder_backend = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_upload_use_internal_tenant = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_volume_cache_enabled = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_volume_cache_max_count = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] image_volume_cache_max_size_gb = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] init_host_max_objects_retrieval = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] instance_format = [instance: %(uuid)s] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] iscsi_target_flags = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] iscsi_write_cache = on {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] iser_helper = tgtadm {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] iser_ip_address = 192.168.122.95 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] iser_port = 3260 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] log_color = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] log_config_append = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] log_dir = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] log_file = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] log_options = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] log_rotate_interval = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] log_rotate_interval_type = days {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] log_rotation_type = none {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[81071]: INFO cinder.volume.manager [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.remotefs [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81071) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] max_age = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] max_logfile_count = 30 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] max_logfile_size_mb = 200 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] max_over_subscription_ratio = 20.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] message_reap_interval = 86400 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] message_ttl = 2592000 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] migration_create_volume_timeout_secs = 300 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] monkey_patch = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] monkey_patch_modules = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] my_ip = 192.168.122.95 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] no_snapshot_gb_quota = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] num_iser_scan_tries = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] num_shell_tries = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] num_volume_device_scan_tries = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] nvmeof_conn_info_version = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] nvmet_ns_id = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] nvmet_port_id = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] osapi_max_limit = 1000 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] osapi_volume_ext_list = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] osapi_volume_listen = 0.0.0.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] osapi_volume_listen_port = 8776 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] osapi_volume_use_ssl = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] osapi_volume_workers = 2 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] per_volume_size_limit = -1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] periodic_fuzzy_delay = 60 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] periodic_interval = 60 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] project_id_regex = [0-9a-f\-]+ {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] public_endpoint = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] publish_errors = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] quota_backup_gigabytes = 1000 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] quota_backups = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] quota_gigabytes = 1000 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] quota_groups = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] quota_snapshots = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] quota_volumes = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] rate_limit_burst = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] rate_limit_except_level = CRITICAL {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] rate_limit_interval = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] reinit_driver_count = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] replication_device = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] report_discard_supported = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] report_interval = 120 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] reservation_clean_interval = 86400 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] reservation_expire = 86400 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] reserved_image_namespaces = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] reserved_percentage = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] rpc_response_timeout = 120 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] run_external_periodic_tasks = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] scst_target_driver = iscsi {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] scst_target_iqn_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_down_time = 720 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] shell_completion = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] snapshot_name_template = snapshot-%s {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] split_loggers = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] state_path = /opt/stack/data/cinder {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] storage_availability_zone = nova {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] storage_protocol = iSCSI {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] syslog_log_facility = LOG_USER {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] target_helper = lioadm {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] target_ip_address = 192.168.122.95 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] target_port = 3260 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] target_protocol = iscsi {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] target_secondary_ip_addresses = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] trace_flags = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] transfer_api_class = cinder.transfer.api.API {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] transport_url = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] until_refresh = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] use_chap_auth = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] use_default_quota_class = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] use_journal = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] use_json = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] use_multipath_for_image_xfer = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] use_stderr = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] use_syslog = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] verify_glance_signatures = enabled {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_api_class = cinder.volume.api.API {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_backend_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_clear = zero {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_clear_ionice = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_clear_size = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_copy_bps_limit = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_dd_blocksize = 1M {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_name_template = volume-%s {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_service_inithost_offload = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volume_usage_audit_period = month {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] zoning_mode = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_concurrency.disable_process_locking = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.admin_password = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.admin_token = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.admin_user = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.auth_admin_prefix = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.auth_port = 35357 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.auth_protocol = https {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.auth_section = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.auth_type = password {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.auth_uri = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.auth_version = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.cache = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.certfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.delay_auth_decision = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81071) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.http_connect_timeout = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: WARNING cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: WARNING cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.identity_uri = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.include_service_catalog = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.insecure = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.interface = public {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.keyfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_password = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Running cmd (subprocess): mount.quobyte {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcache_username = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.region_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.service_token_roles_required = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.service_type = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.token_cache_time = 300 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.backend = dogpile.cache.null {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.backend_argument = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.backend_expiration_time = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.config_prefix = cache.oslo {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.debug_cache_backend = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.enable_retry_client = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.enable_socket_keepalive = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.enabled = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.enforce_fips_mode = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.expiration_time = 600 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.hashclient_retry_attempts = 2 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.memcache_dead_retry = 300 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.memcache_pool_maxsize = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.memcache_sasl_enabled = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.password = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.proxies = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.redis_db = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.redis_sentinel_service_name = mymaster {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.redis_server = localhost:6379 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.retry_attempts = 2 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.retry_delay = 0.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.socket_keepalive_count = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.socket_keepalive_idle = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.socket_keepalive_interval = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.socket_timeout = 1.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.tls_allowed_ciphers = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.tls_cafile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.tls_certfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.tls_enabled = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.tls_keyfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cache.username = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] coordination.backend_url = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.asyncio_connection = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.asyncio_slave_connection = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.backend = sqlalchemy {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.connection = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.connection_debug = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.connection_parameters = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.connection_recycle_time = 3600 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.connection_trace = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.db_inc_retry_interval = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.db_max_retries = 20 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.db_max_retry_interval = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.db_retry_interval = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.max_overflow = 50 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.max_pool_size = 5 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.max_retries = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.mysql_wsrep_sync_wait = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.pool_timeout = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.retry_interval = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.slave_connection = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.sqlite_synchronous = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.synchronous_reader = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] database.use_db_reconnect = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.connection_string = messaging:// {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.enabled = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.es_doc_type = notification {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.es_scroll_size = 10000 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.es_scroll_time = 2m {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.filter_error_trace = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.hmac_keys = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.sentinel_service_name = mymaster {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.socket_timeout = 0.1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.trace_requests = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler.trace_sqlalchemy = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler_jaeger.process_tags = {} {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler_jaeger.service_name_prefix = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] profiler_otlp.service_name_prefix = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.enforce_new_defaults = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: WARNING oslo_config.cfg [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.enforce_scope = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.policy_default_rule = default {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.policy_file = policy.yaml {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_policy.remote_timeout = 60.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] privsep_osbrick.group = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] privsep_osbrick.helper_command = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] privsep_osbrick.user = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cinder_sys_admin.group = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cinder_sys_admin.helper_command = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] cinder_sys_admin.user = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.auth_section = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.auth_type = password {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.cafile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.certfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.collect_timing = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.insecure = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.keyfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.send_service_user_token = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.split_loggers = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] service_user.timeout = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.auth_section = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.auth_type = password {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.certfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.collect_timing = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.insecure = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.keyfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.region_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.split_loggers = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] glance.timeout = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.backend_availability_zone = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.chap_password = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.chap_username = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.disk_geometry = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.driver_client_cert = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.driver_client_cert_key = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.driver_data_namespace = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.driver_use_ssl = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.enable_unsupported_driver = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.extra_capabilities = {} {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack quobyte-client[81072]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 19:11:44 devstack quobyte-client[81072]: Invalid parameters found, error: missing mount point. Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.filter_function = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.goodness_function = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack quobyte-client[81072]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.iscsi_target_flags = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.iscsi_write_cache = on {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.iser_helper = tgtadm {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack quobyte-client[81072]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.iser_port = 3260 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_host = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_login = admin {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_mount_options = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_password = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_private_key = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_share_path = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_ssh_port = 22 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.num_shell_tries = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.nvmet_port_id = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.quobyte_client_cfg = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.quobyte_volume_url = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.replication_device = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.report_discard_supported = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.reserved_percentage = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.scst_target_driver = iscsi {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.scst_target_iqn_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.storage_protocol = iSCSI {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: INFO cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e ... Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.target_helper = tgtadm {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 -c /etc/quobyte/client-cinder.cfg {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.target_port = 3260 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.target_protocol = iscsi {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.trace_flags = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.unique_fqdn_network = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.use_chap_auth = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.volume_backend_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.volume_clear = zero {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.volume_clear_ionice = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.volume_clear_size = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_reports.file_event_handler = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_reports.log_dir = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.backend_availability_zone = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.backend_host = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.chap_password = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.chap_username = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.chiscsi_conf = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.disk_geometry = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.driver_client_cert = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.driver_client_cert_key = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.driver_data_namespace = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.driver_use_ssl = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.extra_capabilities = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.filter_function = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.goodness_function = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.iscsi_target_flags = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.iscsi_write_cache = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.iser_helper = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.iser_ip_address = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.iser_port = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.iser_target_prefix = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_host = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_login = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_mount_options = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_password = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_private_key = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_share_path = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_ssh_port = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.num_shell_tries = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nvmet_ns_id = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.nvmet_port_id = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.replication_device = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.report_discard_supported = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.reserved_percentage = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.scst_target_driver = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.storage_protocol = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.target_helper = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.target_ip_address = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.target_port = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.target_prefix = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.target_protocol = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.trace_flags = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.unique_fqdn_network = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.use_chap_auth = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.volume_clear = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.volume_clear_ionice = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.volume_clear_size = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] QuobyteHD.volumes_dir = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.ssl = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.ssl_version = {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_notifications.driver = [] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_notifications.retry = -1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack sudo[81073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 -c /etc/quobyte/client-cinder.cfg Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] key_manager.fixed_key = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.barbican_api_version = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.barbican_endpoint = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.barbican_endpoint_type = public {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.barbican_region_name = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.cafile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack sudo[81073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.certfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.collect_timing = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.insecure = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.keyfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.number_of_retries = 60 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.retry_delay = 1 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.send_service_user_token = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.split_loggers = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.timeout = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.verify_ssl = True {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican.verify_ssl_path = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican_service_user.auth_section = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican_service_user.auth_type = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican_service_user.cafile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican_service_user.certfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican_service_user.collect_timing = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican_service_user.insecure = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican_service_user.keyfile = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican_service_user.split_loggers = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] barbican_service_user.timeout = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.approle_role_id = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.approle_secret_id = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.kv_mountpoint = secret {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.kv_path = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.kv_version = 2 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.namespace = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.root_token_id = **** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.ssl_ca_crt_file = None {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.timeout = 60.0 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.use_ssl = False {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:44 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] ******************************************************************************** {{(pid=80952) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:11:45 devstack sudo[81073]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.612s {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:45 devstack cinder-volume[81071]: INFO cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e succeeded Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.629s {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:45 devstack sudo[81142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:11:45 devstack sudo[81142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:45 devstack sudo[81142]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.405s {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:45 devstack cinder-volume[81071]: INFO cinder.volume.driver [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG cinder.volume.driver [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7228660583496, 'free_capacity_gb': 1775.7228660583496, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81071) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG oslo_db.sqlalchemy.engines [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81071) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG dbcounter [-] [81071] Writer thread running {{(pid=81071) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG cinder.db.sqlalchemy.api [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Building query based on filter {{(pid=81071) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG cinder.image.image_utils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81071) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:11:45 devstack cinder-volume[81071]: INFO cinder.keymgr.migration [None req-7ae19354-bd46-4a19-8335-65e0351573cc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:45 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:45 devstack sudo[81145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:11:45 devstack sudo[81145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:46 devstack sudo[81145]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.427s {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG cinder.manager [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Notifying Schedulers of capabilities ... {{(pid=81071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:11:46 devstack cinder-volume[81071]: INFO cinder.volume.manager [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Driver initialization completed successfully. Apr 24 19:11:46 devstack cinder-volume[81071]: INFO cinder.manager [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Initiating service 3 cleanup Apr 24 19:11:46 devstack cinder-volume[81071]: INFO cinder.manager [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Service 3 cleanup completed. Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG cinder.service [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Creating RPC server for service cinder-volume {{(pid=81071) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG cinder.service [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81071) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:11:46 devstack cinder-volume[81071]: INFO cinder.volume.manager [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.quobyte [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:46 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:46 devstack sudo[81151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:11:46 devstack sudo[81151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:47 devstack sudo[81151]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:47 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.525s {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:47 devstack cinder-volume[81071]: INFO cinder.volume.manager [None req-df5d3362-1e30-4a39-8749-ec8f1ca30866 None None] Driver post RPC initialization completed successfully. Apr 24 19:11:50 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-6804d6a8-1f4f-4b46-8ce9-79c6fa9fd24f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:50 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-6804d6a8-1f4f-4b46-8ce9-79c6fa9fd24f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:50 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.quobyte [None req-6804d6a8-1f4f-4b46-8ce9-79c6fa9fd24f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:11:50 devstack cinder-volume[81071]: DEBUG cinder.volume.drivers.quobyte [None req-6804d6a8-1f4f-4b46-8ce9-79c6fa9fd24f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:11:50 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-6804d6a8-1f4f-4b46-8ce9-79c6fa9fd24f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:50 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-6804d6a8-1f4f-4b46-8ce9-79c6fa9fd24f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:50 devstack sudo[81260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:11:50 devstack sudo[81260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:50 devstack sudo[81260]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:50 devstack cinder-volume[81071]: DEBUG oslo_concurrency.processutils [None req-6804d6a8-1f4f-4b46-8ce9-79c6fa9fd24f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.434s {{(pid=81071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:50 devstack cinder-volume[81071]: DEBUG cinder.manager [None req-6804d6a8-1f4f-4b46-8ce9-79c6fa9fd24f None None] Notifying Schedulers of capabilities ... {{(pid=81071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:11:53 devstack cinder-volume[80952]: INFO oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Caught SIGTERM, stopping children Apr 24 19:11:53 devstack cinder-volume[80952]: DEBUG oslo_concurrency.lockutils [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Acquiring lock "singleton_lock" {{(pid=80952) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:11:53 devstack cinder-volume[80952]: DEBUG oslo_concurrency.lockutils [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Acquired lock "singleton_lock" {{(pid=80952) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:11:53 devstack cinder-volume[80952]: DEBUG oslo_concurrency.lockutils [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Releasing lock "singleton_lock" {{(pid=80952) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:11:53 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Stop services. {{(pid=80952) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 19:11:53 devstack cinder-volume[80952]: DEBUG oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Killing children. {{(pid=80952) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 19:11:53 devstack cinder-volume[80952]: INFO oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Waiting on 1 children to exit Apr 24 19:11:54 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Acquiring lock "singleton_lock" {{(pid=81071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:11:54 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Acquired lock "singleton_lock" {{(pid=81071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:11:54 devstack cinder-volume[81071]: DEBUG oslo_concurrency.lockutils [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Releasing lock "singleton_lock" {{(pid=81071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:11:54 devstack cinder-volume[81071]: WARNING amqp [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:11:54 devstack cinder-volume[81071]: WARNING amqp [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:11:54 devstack cinder-volume[80952]: INFO oslo_service.backend._eventlet.service [None req-4634362c-91b6-4b95-860e-1d34466c3999 None None] Child 81071 exited with status 0 Apr 24 19:11:55 devstack cinder-volume[81339]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:11:55 devstack cinder-volume[81339]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:11:55 devstack cinder-volume[81339]: we strongly recommend against using it for new projects. Apr 24 19:11:55 devstack cinder-volume[81339]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:11:55 devstack cinder-volume[81339]: framework. For more detail see Apr 24 19:11:55 devstack cinder-volume[81339]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:11:55 devstack cinder-volume[81339]: import eventlet # noqa Apr 24 19:11:56 devstack cinder-volume[81339]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81339) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:11:56 devstack cinder-volume[81339]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81339) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:11:56 devstack cinder-volume[81339]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81339) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:11:57 devstack cinder-volume[81339]: INFO dbcounter [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Registered counter for database cinder Apr 24 19:11:57 devstack cinder-volume[81339]: DEBUG oslo_db.sqlalchemy.engines [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG dbcounter [-] [81339] Writer thread running {{(pid=81339) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:11:58 devstack cinder-volume[81339]: INFO cinder.rpc [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:11:58 devstack cinder-volume[81339]: INFO cinder.rpc [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_db.sqlalchemy.engines [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:11:58 devstack cinder-volume[81339]: INFO cinder.volume.manager [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Determined volume DB was empty at startup. Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG cinder.volume.manager [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81339) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:11:58 devstack cinder-volume[81339]: WARNING stevedore.named [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:11:58 devstack cinder-volume[81339]: WARNING castellan.key_manager [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:11:58 devstack cinder-volume[81339]: WARNING cinder.keymgr.conf_key_mgr [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:11:58 devstack cinder-volume[81339]: INFO cinder.volume.manager [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_db.sqlalchemy.engines [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:11:58 devstack cinder-volume[81339]: INFO oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Starting 1 workers Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Started child 81522 {{(pid=81339) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Full set of CONF: {{(pid=81339) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] ******************************************************************************** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Configuration options gathered from: {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] ================================================================================ {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] allow_availability_zone_fallback = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] allow_compression_on_image_upload = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] allowed_direct_url_schemes = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] api_rate_limit = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] auth_strategy = keystone {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_availability_zone = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_host = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_stats_polling_interval = 60 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backup_api_class = cinder.backup.api.API {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backup_name_template = backup-%s {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backup_use_same_host = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backup_use_temp_snapshot = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] chap_password = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] chap_username = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cinder_internal_tenant_project_id = 664f9cdd82864bad9800ae08e92112b9 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cinder_internal_tenant_user_id = d9c2e0f88c8749e5896f093c10f9fec3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cluster = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] compression_format = gzip {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] compute_api_class = cinder.compute.nova.API {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] config_dir = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] config_source = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] control_exchange = openstack {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] debug = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] default_availability_zone = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] default_group_type = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] default_volume_type = QuobyteHD {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] disk_geometry = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] driver_client_cert = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] driver_client_cert_key = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] driver_data_namespace = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] driver_ssl_cert_path = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] driver_ssl_cert_verify = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] driver_use_ssl = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] enable_new_services = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] enable_unsupported_driver = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] enabled_backends = ['QuobyteHD'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] enforce_multipath_for_image_xfer = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] filter_function = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_api_insecure = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_api_servers = ['http://192.168.122.95/image'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_api_ssl_compression = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_ca_certificates_file = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_catalog_info = image:glance:publicURL {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_certfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_keyfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_num_retries = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance_request_timeout = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] goodness_function = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] graceful_shutdown_timeout = 5 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] group_api_class = cinder.group.api.API {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] host = devstack {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_compress_on_upload = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_conversion_address_space_limit = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_conversion_cpu_limit = 60 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_conversion_disable = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_upload_use_cinder_backend = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_upload_use_internal_tenant = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_volume_cache_enabled = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_volume_cache_max_count = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] image_volume_cache_max_size_gb = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] init_host_max_objects_retrieval = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] instance_format = [instance: %(uuid)s] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] iscsi_target_flags = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] iscsi_write_cache = on {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] iser_helper = tgtadm {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] iser_ip_address = 192.168.122.95 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] iser_port = 3260 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] log_color = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] log_config_append = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] log_dir = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] log_file = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] log_options = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] log_rotate_interval = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] log_rotate_interval_type = days {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] log_rotation_type = none {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] max_age = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] max_logfile_count = 30 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] max_logfile_size_mb = 200 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] max_over_subscription_ratio = 20.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] message_reap_interval = 86400 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] message_ttl = 2592000 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] migration_create_volume_timeout_secs = 300 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] monkey_patch = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] monkey_patch_modules = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] my_ip = 192.168.122.95 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] no_snapshot_gb_quota = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] num_iser_scan_tries = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] num_shell_tries = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] num_volume_device_scan_tries = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] nvmeof_conn_info_version = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] nvmet_ns_id = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] nvmet_port_id = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] osapi_max_limit = 1000 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] osapi_volume_ext_list = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] osapi_volume_listen_port = 8776 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] osapi_volume_use_ssl = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] osapi_volume_workers = 2 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] per_volume_size_limit = -1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] periodic_fuzzy_delay = 60 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81522]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] periodic_interval = 60 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] public_endpoint = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] publish_errors = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] quota_backup_gigabytes = 1000 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] quota_backups = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] quota_gigabytes = 1000 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] quota_groups = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] quota_snapshots = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] quota_volumes = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] rate_limit_burst = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] rate_limit_except_level = CRITICAL {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] rate_limit_interval = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] reinit_driver_count = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] replication_device = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] report_discard_supported = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] report_interval = 120 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] reservation_clean_interval = 86400 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] reservation_expire = 86400 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] reserved_image_namespaces = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] reserved_percentage = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] rpc_response_timeout = 120 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] run_external_periodic_tasks = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] scst_target_driver = iscsi {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] scst_target_iqn_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_down_time = 720 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] shell_completion = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] snapshot_name_template = snapshot-%s {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] split_loggers = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] state_path = /opt/stack/data/cinder {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] storage_availability_zone = nova {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] storage_protocol = iSCSI {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] syslog_log_facility = LOG_USER {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] target_helper = lioadm {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] target_ip_address = 192.168.122.95 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] target_port = 3260 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] target_protocol = iscsi {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] target_secondary_ip_addresses = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] trace_flags = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] transport_url = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] until_refresh = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] use_chap_auth = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] use_default_quota_class = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] use_journal = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] use_json = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] use_multipath_for_image_xfer = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] use_stderr = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] use_syslog = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] verify_glance_signatures = enabled {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_api_class = cinder.volume.api.API {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_backend_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_clear = zero {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_clear_ionice = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_clear_size = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_copy_bps_limit = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_dd_blocksize = 1M {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_name_template = volume-%s {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_service_inithost_offload = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volume_usage_audit_period = month {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] zoning_mode = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_concurrency.disable_process_locking = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.admin_password = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81522) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.admin_token = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.admin_user = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.auth_port = 35357 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.auth_protocol = https {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.auth_section = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.auth_type = password {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.auth_uri = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.auth_version = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.cache = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.certfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.identity_uri = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.include_service_catalog = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.insecure = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.interface = public {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.keyfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_password = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcache_username = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.region_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.service_type = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.backend = dogpile.cache.null {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.backend_argument = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.backend_expiration_time = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.config_prefix = cache.oslo {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.debug_cache_backend = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.enable_retry_client = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.enable_socket_keepalive = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.enabled = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.enforce_fips_mode = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.expiration_time = 600 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.hashclient_retry_attempts = 2 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.memcache_dead_retry = 300 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.memcache_pool_maxsize = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.memcache_sasl_enabled = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.password = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.proxies = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.redis_db = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.redis_server = localhost:6379 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.retry_attempts = 2 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.retry_delay = 0.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.socket_keepalive_count = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.socket_keepalive_idle = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.socket_keepalive_interval = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.socket_timeout = 1.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.tls_allowed_ciphers = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81522) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 19:11:58 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.quobyte [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 19:11:58 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.quobyte [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.tls_cafile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.tls_certfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.tls_enabled = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Running cmd (subprocess): mount.quobyte {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.tls_keyfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cache.username = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] coordination.backend_url = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.asyncio_connection = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.asyncio_slave_connection = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.backend = sqlalchemy {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.connection = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.connection_debug = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.connection_parameters = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.connection_recycle_time = 3600 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.connection_trace = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.db_inc_retry_interval = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.db_max_retries = 20 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.db_max_retry_interval = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.db_retry_interval = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.max_overflow = 50 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.max_pool_size = 5 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.max_retries = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.mysql_wsrep_sync_wait = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.pool_timeout = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.retry_interval = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.slave_connection = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.sqlite_synchronous = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.synchronous_reader = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] database.use_db_reconnect = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.connection_string = messaging:// {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.enabled = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.es_doc_type = notification {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.es_scroll_size = 10000 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.es_scroll_time = 2m {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.filter_error_trace = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.hmac_keys = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.sentinel_service_name = mymaster {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.socket_timeout = 0.1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.trace_requests = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler.trace_sqlalchemy = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler_jaeger.process_tags = {} {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler_jaeger.service_name_prefix = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] profiler_otlp.service_name_prefix = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.enforce_new_defaults = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: WARNING oslo_config.cfg [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.enforce_scope = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.policy_default_rule = default {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.policy_file = policy.yaml {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] privsep_osbrick.group = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] privsep_osbrick.helper_command = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack quobyte-client[81549]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 19:11:58 devstack quobyte-client[81549]: Invalid parameters found, error: missing mount point. Apr 24 19:11:58 devstack quobyte-client[81549]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 19:11:58 devstack quobyte-client[81549]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] privsep_osbrick.user = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cinder_sys_admin.group = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cinder_sys_admin.helper_command = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] cinder_sys_admin.user = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.auth_section = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.auth_type = password {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.cafile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.certfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.collect_timing = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.insecure = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.keyfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.send_service_user_token = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.split_loggers = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] service_user.timeout = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.auth_section = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.auth_type = password {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.certfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.collect_timing = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.insecure = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.keyfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.region_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.split_loggers = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] glance.timeout = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.backend_availability_zone = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.chap_password = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.chap_username = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.disk_geometry = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.driver_client_cert = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.driver_client_cert_key = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.driver_data_namespace = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.driver_use_ssl = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack sudo[81550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:11:58 devstack sudo[81550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.extra_capabilities = {} {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.filter_function = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.goodness_function = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.iscsi_target_flags = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.iscsi_write_cache = on {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.iser_helper = tgtadm {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.iser_port = 3260 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_host = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_login = admin {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_mount_options = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_password = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_private_key = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_share_path = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.num_shell_tries = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.quobyte_volume_url = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.replication_device = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.report_discard_supported = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.reserved_percentage = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.target_helper = tgtadm {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.target_port = 3260 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.target_protocol = iscsi {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.trace_flags = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.unique_fqdn_network = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.use_chap_auth = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.volume_backend_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.volume_clear = zero {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.volume_clear_ionice = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.volume_clear_size = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_reports.file_event_handler = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_reports.log_dir = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.backend_availability_zone = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.backend_host = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.chap_password = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.chap_username = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.chiscsi_conf = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.disk_geometry = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.driver_client_cert = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.driver_data_namespace = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.driver_use_ssl = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.extra_capabilities = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.filter_function = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.goodness_function = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.iser_helper = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.iser_ip_address = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.iser_port = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.iser_target_prefix = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_host = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_login = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_mount_options = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_password = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_private_key = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_share_path = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_ssh_port = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.num_shell_tries = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.nvmet_port_id = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.replication_device = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.report_discard_supported = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.reserved_percentage = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.scst_target_driver = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.storage_protocol = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.target_helper = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.target_ip_address = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.target_port = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.target_prefix = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.target_protocol = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.trace_flags = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.use_chap_auth = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.volume_clear = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.volume_clear_size = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] QuobyteHD.volumes_dir = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.ssl = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_notifications.driver = [] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_notifications.retry = -1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] key_manager.fixed_key = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.barbican_api_version = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.barbican_endpoint = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.barbican_endpoint_type = public {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.barbican_region_name = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.cafile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.certfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.collect_timing = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.insecure = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.keyfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.number_of_retries = 60 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.retry_delay = 1 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.send_service_user_token = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.split_loggers = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.timeout = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.verify_ssl = True {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican.verify_ssl_path = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican_service_user.auth_section = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican_service_user.auth_type = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican_service_user.cafile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican_service_user.certfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican_service_user.collect_timing = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican_service_user.insecure = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican_service_user.keyfile = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican_service_user.split_loggers = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] barbican_service_user.timeout = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.approle_role_id = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.approle_secret_id = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.kv_mountpoint = secret {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.kv_path = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.kv_version = 2 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.namespace = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.root_token_id = **** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.ssl_ca_crt_file = None {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.timeout = 60.0 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.use_ssl = False {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:11:58 devstack cinder-volume[81339]: DEBUG oslo_service.backend._eventlet.service [None req-fb98f9cf-bfb6-4aff-a2e5-aebc30cdd5a5 None None] ******************************************************************************** {{(pid=81339) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:11:59 devstack sudo[81550]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.470s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:59 devstack cinder-volume[81522]: INFO cinder.volume.driver [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.volume.driver [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7228660583496, 'free_capacity_gb': 1775.7228660583496, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81522) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_db.sqlalchemy.engines [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81522) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writer thread running {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.db.sqlalchemy.api [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Building query based on filter {{(pid=81522) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81522) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:59 devstack cinder-volume[81522]: INFO cinder.keymgr.migration [None req-f614ca17-59cd-47ad-b32f-cca5e2686ab0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:11:59 devstack sudo[81572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:11:59 devstack sudo[81572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:59 devstack sudo[81572]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.434s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:11:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Driver initialization completed successfully. Apr 24 19:11:59 devstack cinder-volume[81522]: INFO cinder.manager [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Initiating service 3 cleanup Apr 24 19:11:59 devstack cinder-volume[81522]: INFO cinder.manager [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Service 3 cleanup completed. Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.service [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Creating RPC server for service cinder-volume {{(pid=81522) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.service [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81522) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:11:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:59 devstack sudo[81584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:11:59 devstack sudo[81584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:00 devstack sudo[81584]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.462s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:00 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9fac9443-cb0c-4861-8fc7-ce4e5f6d8511 None None] Driver post RPC initialization completed successfully. Apr 24 19:12:08 devstack cinder-volume[81339]: DEBUG dbcounter [-] [81339] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81339) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:12:09 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:12:10 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=3 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Flow 'volume_create_manager' (8826a1c0-4b72-4ea8-80f8-0e0fe33ea816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6472939d-4690-4cbf-9806-c1127f32a0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6472939d-4690-4cbf-9806-c1127f32a0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-52299491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4c1eeb-21bf-439e-9421-7d46c65ec269,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e51c9e5a84b24c0cb8b61c60c96c1806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:00Z,use_quota=True,user_id='f20bf2576ba14dada921bb06d5cba846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bcd241-e004-4320-abab-815fe33cefe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bcd241-e004-4320-abab-815fe33cefe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7b65fb-4b35-453c-9eda-1bbff8340773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7b65fb-4b35-453c-9eda-1bbff8340773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4c1eeb-21bf-439e-9421-7d46c65ec269', 'volume_name': 'volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93b0afe-d0bc-40ab-b33c-ac6fb7ecaa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93b0afe-d0bc-40ab-b33c-ac6fb7ecaa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c43af3b-a461-4378-ab88-a3b504d4bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Volume 4e4c1eeb-21bf-439e-9421-7d46c65ec269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269', 'volume_size': 1} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-52299491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4c1eeb-21bf-439e-9421-7d46c65ec269,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e51c9e5a84b24c0cb8b61c60c96c1806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:00Z,use_quota=True,user_id='f20bf2576ba14dada921bb06d5cba846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Creating volume 4e4c1eeb-21bf-439e-9421-7d46c65ec269 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:00 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:00 devstack sudo[82065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 1073741824 Apr 24 19:13:00 devstack sudo[82065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Flow 'volume_create_manager' (23d9cc0e-576d-41a7-949a-d7b7759ef1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f37059-c2d2-485b-b6e4-2010fc28074b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f37059-c2d2-485b-b6e4-2010fc28074b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2029266581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1ef771-5c7a-4881-a05f-6ab4c7394a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3732f0f3690472f9a48bca8f402fd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:00Z,use_quota=True,user_id='98cd317ff5194f819b97e4f167a5bc29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7c40f2-9a67-4c1c-ba75-813abf1acf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7c40f2-9a67-4c1c-ba75-813abf1acf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf67e1c-1265-4e77-998a-2417d82a72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf67e1c-1265-4e77-998a-2417d82a72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1ef771-5c7a-4881-a05f-6ab4c7394a8d', 'volume_name': 'volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab7433f-1ae1-43d5-9184-91ad54ba90b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab7433f-1ae1-43d5-9184-91ad54ba90b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3069d3e-34a1-49a4-aeed-bce4c9f9f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:00 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Volume 8a1ef771-5c7a-4881-a05f-6ab4c7394a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d', 'volume_size': 1} Apr 24 19:13:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:02 devstack sudo[82065]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 1073741824" returned: 0 in 2.040s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:02 devstack sudo[82392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 Apr 24 19:13:02 devstack sudo[82392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:03 devstack sudo[82392]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269" returned: 0 in 1.349s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] <== create_volume: return (3489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.493s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.133s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2029266581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1ef771-5c7a-4881-a05f-6ab4c7394a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3732f0f3690472f9a48bca8f402fd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:00Z,use_quota=True,user_id='98cd317ff5194f819b97e4f167a5bc29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Creating volume 8a1ef771-5c7a-4881-a05f-6ab4c7394a8d {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:03 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:13:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:04 devstack sudo[82420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d 1073741824 Apr 24 19:13:04 devstack sudo[82420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c43af3b-a461-4378-ab88-a3b504d4bc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3649c74-e02d-44af-a74b-200d65429a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:04 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Volume volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 (4e4c1eeb-21bf-439e-9421-7d46c65ec269): created successfully Apr 24 19:13:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3649c74-e02d-44af-a74b-200d65429a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Flow 'volume_create_manager' (8826a1c0-4b72-4ea8-80f8-0e0fe33ea816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:04 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-33b5fa52-b159-4a22-99b1-776f9d1a67ef tempest-VolumesTestJSON-641910198 None] Created volume successfully. Apr 24 19:13:05 devstack sudo[82420]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d 1073741824" returned: 0 in 1.297s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:05 devstack sudo[82459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d Apr 24 19:13:05 devstack sudo[82459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Flow 'volume_create_manager' (09305a84-fb67-4d23-a2c5-e4b1f322893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fbe793-a630-4689-9f2c-443130069174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fbe793-a630-4689-9f2c-443130069174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-427611622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a5ab10-3508-41b3-88d5-0792205bf864,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e51c9e5a84b24c0cb8b61c60c96c1806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:06Z,use_quota=True,user_id='f20bf2576ba14dada921bb06d5cba846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13535797-6e1a-4aea-97f5-a4b5ba117371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13535797-6e1a-4aea-97f5-a4b5ba117371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f681785-f361-4c4b-a3d3-aba883c3cd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f681785-f361-4c4b-a3d3-aba883c3cd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a5ab10-3508-41b3-88d5-0792205bf864', 'volume_name': 'volume-01a5ab10-3508-41b3-88d5-0792205bf864', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d667a897-4ae5-49e5-8222-cc670dec0089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d667a897-4ae5-49e5-8222-cc670dec0089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c8b9c4-9593-402a-8588-735f1ddf9dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:05 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Volume 01a5ab10-3508-41b3-88d5-0792205bf864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a5ab10-3508-41b3-88d5-0792205bf864', 'volume_size': 1} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:06 devstack sudo[82459]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d" returned: 0 in 0.712s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-427611622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a5ab10-3508-41b3-88d5-0792205bf864,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e51c9e5a84b24c0cb8b61c60c96c1806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:06Z,use_quota=True,user_id='f20bf2576ba14dada921bb06d5cba846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Creating volume 01a5ab10-3508-41b3-88d5-0792205bf864 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:06 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:06 devstack sudo[82482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864 1073741824 Apr 24 19:13:06 devstack sudo[82482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3069d3e-34a1-49a4-aeed-bce4c9f9f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04dc719-7530-4de7-95ef-c370fc2224ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:06 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Volume volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d (8a1ef771-5c7a-4881-a05f-6ab4c7394a8d): created successfully Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04dc719-7530-4de7-95ef-c370fc2224ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Flow 'volume_create_manager' (23d9cc0e-576d-41a7-949a-d7b7759ef1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:06 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d893f170-705e-4b90-bbf7-9a2f755b0bbc tempest-DeleteServersTestJSON-2086512170 None] Created volume successfully. Apr 24 19:13:06 devstack sudo[82482]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864 1073741824" returned: 0 in 0.821s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:06 devstack sudo[82487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864 Apr 24 19:13:06 devstack sudo[82487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:07 devstack sudo[82487]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864" returned: 0 in 0.727s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c8b9c4-9593-402a-8588-735f1ddf9dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a5ab10-3508-41b3-88d5-0792205bf864', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e18ef9-8997-4e23-bd3a-b16db7217075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:07 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Volume volume-01a5ab10-3508-41b3-88d5-0792205bf864 (01a5ab10-3508-41b3-88d5-0792205bf864): created successfully Apr 24 19:13:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e18ef9-8997-4e23-bd3a-b16db7217075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Flow 'volume_create_manager' (09305a84-fb67-4d23-a2c5-e4b1f322893d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:07 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9a6202dd-3b96-4fa0-a67f-17cf1aee7fc3 tempest-VolumesTestJSON-641910198 None] Created volume successfully. Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Flow 'volume_create_manager' (07043515-5fad-44d3-9408-42b34ab7a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e95733d-31c0-4bc4-8312-6db596c815ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e95733d-31c0-4bc4-8312-6db596c815ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-322756195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69697c0f-5ce0-499f-a48f-87b8c8bc70c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e51c9e5a84b24c0cb8b61c60c96c1806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:09Z,use_quota=True,user_id='f20bf2576ba14dada921bb06d5cba846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ae51f7-8988-465b-a303-3bc0db3ed51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ae51f7-8988-465b-a303-3bc0db3ed51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6613741a-d77b-4c90-bd90-82c2bcfbce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6613741a-d77b-4c90-bd90-82c2bcfbce1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69697c0f-5ce0-499f-a48f-87b8c8bc70c6', 'volume_name': 'volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6175a3-f15b-45ad-b81e-5408f5d8224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6175a3-f15b-45ad-b81e-5408f5d8224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1244de-44dd-4768-a918-16ef423406a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:08 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Volume 69697c0f-5ce0-499f-a48f-87b8c8bc70c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6', 'volume_size': 1} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-322756195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69697c0f-5ce0-499f-a48f-87b8c8bc70c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e51c9e5a84b24c0cb8b61c60c96c1806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:09Z,use_quota=True,user_id='f20bf2576ba14dada921bb06d5cba846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Creating volume 69697c0f-5ce0-499f-a48f-87b8c8bc70c6 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:08 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:13:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:09 devstack sudo[82503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 1073741824 Apr 24 19:13:09 devstack sudo[82503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:09 devstack sudo[82503]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 1073741824" returned: 0 in 0.880s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:09 devstack sudo[82512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 Apr 24 19:13:09 devstack sudo[82512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:10 devstack sudo[82512]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6" returned: 0 in 0.555s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1244de-44dd-4768-a918-16ef423406a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae15879c-cf97-479a-a182-790f6e7c91c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:10 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Volume volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 (69697c0f-5ce0-499f-a48f-87b8c8bc70c6): created successfully Apr 24 19:13:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae15879c-cf97-479a-a182-790f6e7c91c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Flow 'volume_create_manager' (07043515-5fad-44d3-9408-42b34ab7a59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f4ae9cc2-0240-44b4-81c7-f9762892f264 tempest-VolumesTestJSON-641910198 None] Created volume successfully. Apr 24 19:13:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Acquiring lock "cinder-69697c0f-5ce0-499f-a48f-87b8c8bc70c6-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Lock "cinder-69697c0f-5ce0-499f-a48f-87b8c8bc70c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Acquiring lock "cinder-quobyte-69697c0f-5ce0-499f-a48f-87b8c8bc70c6" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Lock "cinder-quobyte-69697c0f-5ce0-499f-a48f-87b8c8bc70c6" acquired by "delete_volume" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:12 devstack cinder-volume[81522]: INFO oslo.privsep.daemon [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb6scuvae/privsep.sock'] Apr 24 19:13:12 devstack sudo[82531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb6scuvae/privsep.sock Apr 24 19:13:12 devstack sudo[82531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING py.warnings [req-873a3262-1f85-4b92-b955-bec7434227bf req-008e91b1-9682-44de-84e4-918972cf9e0b tempest-DeleteServersTestJSON-2086512170 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 24 19:13:12 devstack cinder-volume[81522]: .first() Apr 24 19:13:12 devstack cinder-volume[81522]: Apr 24 19:13:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-873a3262-1f85-4b92-b955-bec7434227bf req-008e91b1-9682-44de-84e4-918972cf9e0b tempest-DeleteServersTestJSON-2086512170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-873a3262-1f85-4b92-b955-bec7434227bf req-008e91b1-9682-44de-84e4-918972cf9e0b tempest-DeleteServersTestJSON-2086512170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:13:12 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 24 19:13:13 devstack sudo[82531]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:13 devstack cinder-volume[81522]: INFO oslo.privsep.daemon [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Spawned new privsep daemon via rootwrap Apr 24 19:13:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Accepted privsep connection to /tmp/tmpb6scuvae/privsep.sock {{(pid=81522) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 24 19:13:13 devstack cinder-volume[81522]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 24 19:13:13 devstack cinder-volume[81522]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 24 19:13:13 devstack cinder-volume[81522]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 24 19:13:13 devstack cinder-volume[81522]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82537 Apr 24 19:13:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a5e488-11f1-4b09-9724-c888571d6474]: (2,) {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:13 devstack cinder-volume[81522]: WARNING oslo_privsep.priv_context [req-873a3262-1f85-4b92-b955-bec7434227bf req-008e91b1-9682-44de-84e4-918972cf9e0b tempest-DeleteServersTestJSON-2086512170 None] privsep daemon already running Apr 24 19:13:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[330df99c-a143-4771-b44c-c1564bd2ad0f]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb96034-8941-48b2-9f32-d23a630d70f7]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-873a3262-1f85-4b92-b955-bec7434227bf req-008e91b1-9682-44de-84e4-918972cf9e0b tempest-DeleteServersTestJSON-2086512170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:13 devstack sudo[82541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d Apr 24 19:13:13 devstack sudo[82541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:14 devstack sudo[82540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 Apr 24 19:13:14 devstack sudo[82540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:14 devstack sudo[82541]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-873a3262-1f85-4b92-b955-bec7434227bf req-008e91b1-9682-44de-84e4-918972cf9e0b tempest-DeleteServersTestJSON-2086512170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d" returned: 0 in 0.938s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-873a3262-1f85-4b92-b955-bec7434227bf req-008e91b1-9682-44de-84e4-918972cf9e0b tempest-DeleteServersTestJSON-2086512170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.203s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-873a3262-1f85-4b92-b955-bec7434227bf req-008e91b1-9682-44de-84e4-918972cf9e0b tempest-DeleteServersTestJSON-2086512170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e', 'name': 'volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79f673d2-86b0-4b1d-a064-160dabe34816', 'enforce_multipath': True} {{(pid=81522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:13:15 devstack sudo[82540]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6" returned: 0 in 1.242s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:15 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-873a3262-1f85-4b92-b955-bec7434227bf req-008e91b1-9682-44de-84e4-918972cf9e0b tempest-DeleteServersTestJSON-2086512170 None] attachment_update completed successfully. Apr 24 19:13:15 devstack sudo[82551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6 Apr 24 19:13:15 devstack sudo[82551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Flow 'volume_create_manager' (5de3eff5-0370-4985-8a7d-4f18de24f991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f7b640-541c-47c1-9a5c-9aa42ca5ea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f7b640-541c-47c1-9a5c-9aa42ca5ea79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:15Z,deleted=False,deleted_at=None,display_description='',display_name='10e6aace-7b72-4578-a7d0-284d9827ec56-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517fa642-ed09-4071-99a9-92dfb795092d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228bdcebf3d94021901e00478d1b8bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:15Z,use_quota=True,user_id='cba2c5265604401284bb1052fd90d520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fbf298-cc86-49b2-b1f2-117722bb6537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fbf298-cc86-49b2-b1f2-117722bb6537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c3c23a-992d-40e5-bae7-dabb716479cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c3c23a-992d-40e5-bae7-dabb716479cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '517fa642-ed09-4071-99a9-92dfb795092d', 'volume_name': 'volume-517fa642-ed09-4071-99a9-92dfb795092d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf27bf1-568d-4631-9b46-c32c989e6c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf27bf1-568d-4631-9b46-c32c989e6c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a3703-90de-4633-91a9-0c12e367d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:15 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Volume 517fa642-ed09-4071-99a9-92dfb795092d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-517fa642-ed09-4071-99a9-92dfb795092d', 'volume_size': 1} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:15Z,deleted=False,deleted_at=None,display_description='',display_name='10e6aace-7b72-4578-a7d0-284d9827ec56-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517fa642-ed09-4071-99a9-92dfb795092d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228bdcebf3d94021901e00478d1b8bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:15Z,use_quota=True,user_id='cba2c5265604401284bb1052fd90d520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Creating volume 517fa642-ed09-4071-99a9-92dfb795092d {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:15 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:15 devstack sudo[82553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d 1073741824 Apr 24 19:13:15 devstack sudo[82553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:15 devstack sudo[82551]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-69697c0f-5ce0-499f-a48f-87b8c8bc70c6" returned: 0 in 0.598s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Lock "cinder-quobyte-69697c0f-5ce0-499f-a48f-87b8c8bc70c6" released by "delete_volume" :: held 3.287s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:15 devstack cinder-volume[81522]: WARNING cinder.quota [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:13:15 devstack cinder-volume[81522]: WARNING cinder.quota [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Created reservations ['daeac356-0046-4b78-839d-b54f5282c0f2', '5899b31b-eba9-451b-af33-a2ff43d75224', '1fd6011f-6842-4676-93c2-7facb0ddb6d7', '241032c7-8d37-4c26-839a-dccc0847b571'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:15 devstack sudo[82563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:13:15 devstack sudo[82563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Acquiring lock "cinder-01a5ab10-3508-41b3-88d5-0792205bf864-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Lock "cinder-01a5ab10-3508-41b3-88d5-0792205bf864-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Acquiring lock "cinder-quobyte-01a5ab10-3508-41b3-88d5-0792205bf864" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Lock "cinder-quobyte-01a5ab10-3508-41b3-88d5-0792205bf864" acquired by "delete_volume" :: waited 0.046s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[243c3dd0-be17-42d7-9f43-2a0d415e727d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:16 devstack sudo[82553]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d 1073741824" returned: 0 in 1.060s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:16 devstack sudo[82633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d Apr 24 19:13:16 devstack sudo[82633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:16 devstack sudo[82631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864 Apr 24 19:13:16 devstack sudo[82631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:16 devstack sudo[82563]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.664s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:16 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Deleted volume successfully. Apr 24 19:13:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee3a23e7-1f47-4f18-833c-ac82c545b9e9 tempest-VolumesTestJSON-641910198 None] Lock "cinder-69697c0f-5ce0-499f-a48f-87b8c8bc70c6-delete_volume" released by "delete_volume" :: held 4.280s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:17 devstack sudo[82633]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d" returned: 0 in 0.637s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a3703-90de-4633-91a9-0c12e367d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517fa642-ed09-4071-99a9-92dfb795092d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c676d630-7484-4855-a630-489088523846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:17 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Volume volume-517fa642-ed09-4071-99a9-92dfb795092d (517fa642-ed09-4071-99a9-92dfb795092d): created successfully Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c676d630-7484-4855-a630-489088523846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Flow 'volume_create_manager' (5de3eff5-0370-4985-8a7d-4f18de24f991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:17 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-268e8cca-2fe8-48cc-9623-6eb7eea26472 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Created volume successfully. Apr 24 19:13:17 devstack sudo[82631]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864" returned: 0 in 0.958s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:17 devstack sudo[82959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864 Apr 24 19:13:17 devstack sudo[82959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:17 devstack sudo[82959]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-01a5ab10-3508-41b3-88d5-0792205bf864" returned: 0 in 0.581s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Lock "cinder-quobyte-01a5ab10-3508-41b3-88d5-0792205bf864" released by "delete_volume" :: held 1.580s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:17 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Created reservations ['7a98a080-8618-4729-b499-e50e4962d563', '4e4ec7fa-ffc6-4585-af39-36ace842407e', '70bb2a0d-4121-4d21-aa8f-69932f0b1722', '2c7bdb85-c212-4c5a-91ee-55485d035667'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:18 devstack sudo[82963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:13:18 devstack sudo[82963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Acquiring lock "cinder-4e4c1eeb-21bf-439e-9421-7d46c65ec269-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Lock "cinder-4e4c1eeb-21bf-439e-9421-7d46c65ec269-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Acquiring lock "cinder-quobyte-4e4c1eeb-21bf-439e-9421-7d46c65ec269" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Lock "cinder-quobyte-4e4c1eeb-21bf-439e-9421-7d46c65ec269" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[954a9bb6-1478-4781-96d4-78753745d17b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:18 devstack sudo[82963]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.725s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:18 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Deleted volume successfully. Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0a7c3c77-dc34-471d-b4a1-1ecb3cb8623f tempest-VolumesTestJSON-641910198 None] Lock "cinder-01a5ab10-3508-41b3-88d5-0792205bf864-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:18 devstack sudo[82969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 Apr 24 19:13:18 devstack sudo[82969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-c1280d68-03f6-46e2-8943-156028b90a89 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-c1280d68-03f6-46e2-8943-156028b90a89 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc22aa5b-2d74-4b83-9ceb-f716e8172962]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-c1280d68-03f6-46e2-8943-156028b90a89 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:19 devstack sudo[82976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d Apr 24 19:13:19 devstack sudo[82976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:19 devstack sudo[82969]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269" returned: 0 in 0.816s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:19 devstack sudo[82982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269 Apr 24 19:13:19 devstack sudo[82982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:19 devstack sudo[82976]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-c1280d68-03f6-46e2-8943-156028b90a89 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d" returned: 0 in 0.829s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-c1280d68-03f6-46e2-8943-156028b90a89 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-c1280d68-03f6-46e2-8943-156028b90a89 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e', 'name': 'volume-517fa642-ed09-4071-99a9-92dfb795092d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9858a48-7f96-4037-aea8-73a77b4729da', 'enforce_multipath': True} {{(pid=81522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:13:19 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-c1280d68-03f6-46e2-8943-156028b90a89 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] attachment_update completed successfully. Apr 24 19:13:20 devstack sudo[82982]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4e4c1eeb-21bf-439e-9421-7d46c65ec269" returned: 0 in 0.593s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:20 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Lock "cinder-quobyte-4e4c1eeb-21bf-439e-9421-7d46c65ec269" released by "delete_volume" :: held 1.501s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:20 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Created reservations ['a1b2e307-fa6c-4b6c-ae73-d45ab2eeae01', 'c758696a-d222-4f38-9fd5-cc8897982464', 'e063dc07-7191-47d9-b2ea-8a5d224da054', 'cd185e97-10b4-4af9-9c09-00b66984902f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:20 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:20 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:20 devstack sudo[82988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:13:20 devstack sudo[82988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:21 devstack sudo[82988]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.755s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:21 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Deleted volume successfully. Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5808ac61-abf1-4f43-b922-305e3e0433fd tempest-VolumesTestJSON-641910198 None] Lock "cinder-4e4c1eeb-21bf-439e-9421-7d46c65ec269-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:21 devstack sudo[82992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:13:21 devstack sudo[82992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:22 devstack sudo[82992]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.694s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:26 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-f5e12002-1bb9-4696-b4f7-5cf3e9631e07 req-6230873c-a312-4553-b958-5c4acc0095f4 tempest-DeleteServersTestJSON-2086512170 None] Terminate volume connection completed successfully. Apr 24 19:13:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-f5e12002-1bb9-4696-b4f7-5cf3e9631e07 req-6230873c-a312-4553-b958-5c4acc0095f4 tempest-DeleteServersTestJSON-2086512170 None] Deleting attachment 79f673d2-86b0-4b1d-a064-160dabe34816. {{(pid=81522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:13:27 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-0db47ba3-4ee9-4da6-ae78-8d86f3d4fbec tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Terminate volume connection completed successfully. Apr 24 19:13:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-62831c33-254e-4ac6-a046-b59f2fa46469 req-0db47ba3-4ee9-4da6-ae78-8d86f3d4fbec tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Deleting attachment f9858a48-7f96-4037-aea8-73a77b4729da. {{(pid=81522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:13:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Acquiring lock "cinder-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Lock "cinder-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Acquiring lock "cinder-quobyte-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Lock "cinder-quobyte-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:31 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e0a4b9-2b1e-41ea-aad3-03556a9132fd]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:31 devstack sudo[83103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d Apr 24 19:13:31 devstack sudo[83103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:32 devstack sudo[83103]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d" returned: 0 in 0.718s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:32 devstack sudo[83108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d Apr 24 19:13:32 devstack sudo[83108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:32 devstack sudo[83108]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d" returned: 0 in 0.548s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Lock "cinder-quobyte-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d" released by "delete_volume" :: held 1.309s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Created reservations ['7f5fcfe2-4105-48ad-aa1d-8c1f4b02117f', '98c35212-b392-4ba8-995a-f3f23969d586', 'aba041f7-7e05-4dc1-a68e-8074832b6cfb', '79a1e3ce-fcd8-4b0b-9ece-19ff7a3dcae2'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:33 devstack sudo[83111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:13:33 devstack sudo[83111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:33 devstack sudo[83111]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.685s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:33 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Deleted volume successfully. Apr 24 19:13:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e4fb2a0-b6e3-4ed0-84a9-171afe9cedda tempest-DeleteServersTestJSON-2086512170 None] Lock "cinder-8a1ef771-5c7a-4881-a05f-6ab4c7394a8d-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "cinder-517fa642-ed09-4071-99a9-92dfb795092d-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "cinder-517fa642-ed09-4071-99a9-92dfb795092d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "cinder-quobyte-517fa642-ed09-4071-99a9-92dfb795092d" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "cinder-quobyte-517fa642-ed09-4071-99a9-92dfb795092d" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:37 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c76add7-1b4e-49bd-9c4b-408740a73dad]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:37 devstack sudo[83119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d Apr 24 19:13:37 devstack sudo[83119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:38 devstack sudo[83119]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d" returned: 0 in 0.777s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:38 devstack sudo[83125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d Apr 24 19:13:38 devstack sudo[83125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:38 devstack sudo[83125]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-517fa642-ed09-4071-99a9-92dfb795092d" returned: 0 in 0.738s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:38 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "cinder-quobyte-517fa642-ed09-4071-99a9-92dfb795092d" released by "delete_volume" :: held 1.587s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:38 devstack cinder-volume[81522]: DEBUG cinder.quota [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Created reservations ['5318c281-9d53-423e-8a51-c0e35dc4862a', '858c074d-e12d-4bc1-ba9f-0d146d048b69', 'cdf944aa-d336-4dc5-9b4f-ab054a7b3e56', '06888fd5-7ab9-48d8-8a13-7bda3748ed1d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:39 devstack sudo[83128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:13:39 devstack sudo[83128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:39 devstack sudo[83128]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.879s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:39 devstack cinder-volume[81522]: DEBUG cinder.manager [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:39 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Deleted volume successfully. Apr 24 19:13:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7423f8c0-3e17-4cb0-8651-6ea6ac7fcd2a req-31b06671-85ca-4c5d-b875-67caaf578358 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "cinder-517fa642-ed09-4071-99a9-92dfb795092d-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Flow 'volume_create_manager' (918c4e39-caef-45f9-b7e7-3346790bdf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b580c5ad-9712-48a2-a473-9580e6d60cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b580c5ad-9712-48a2-a473-9580e6d60cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-870628044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbba16ec-a424-4974-89cd-1a1fd6fb3e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb9cbd2966a44b7ba26d15dd495e313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:44Z,use_quota=True,user_id='59199b5b1ce34ecc9001d258045926a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1834ba79-9de8-4243-970c-f4fa30b473ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1834ba79-9de8-4243-970c-f4fa30b473ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f418c7f9-8c3a-41be-bd35-c6daaa696ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f418c7f9-8c3a-41be-bd35-c6daaa696ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbba16ec-a424-4974-89cd-1a1fd6fb3e8c', 'volume_name': 'volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b07cac-80f5-4f1a-9f50-b4498a5a112e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b07cac-80f5-4f1a-9f50-b4498a5a112e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177ec1bd-a8e6-4081-bce4-24a8a3ed45a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:44 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Volume fbba16ec-a424-4974-89cd-1a1fd6fb3e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c', 'volume_size': 1} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-870628044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbba16ec-a424-4974-89cd-1a1fd6fb3e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb9cbd2966a44b7ba26d15dd495e313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:44Z,use_quota=True,user_id='59199b5b1ce34ecc9001d258045926a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Creating volume fbba16ec-a424-4974-89cd-1a1fd6fb3e8c {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:44 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:13:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:44 devstack sudo[83145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c 1073741824 Apr 24 19:13:44 devstack sudo[83145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:45 devstack sudo[83145]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c 1073741824" returned: 0 in 0.780s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:45 devstack sudo[83150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c Apr 24 19:13:45 devstack sudo[83150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:45 devstack sudo[83150]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" returned: 0 in 0.707s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177ec1bd-a8e6-4081-bce4-24a8a3ed45a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8827fe7e-0a88-4a46-b6b5-77e512296add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:45 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Volume volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c (fbba16ec-a424-4974-89cd-1a1fd6fb3e8c): created successfully Apr 24 19:13:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8827fe7e-0a88-4a46-b6b5-77e512296add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Flow 'volume_create_manager' (918c4e39-caef-45f9-b7e7-3346790bdf60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:45 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-2a4fbc8b-3cdc-42b2-85ee-c4e2ed986661 req-96fdee65-3edd-497e-b557-230e7f003b2e tempest-VolumesSnapshotsTestJSON-512408972 None] Created volume successfully. Apr 24 19:13:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Creating offline snapshot 99a90ef8-9d7e-4796-84d3-abebf3279fe3 of volume fbba16ec-a424-4974-89cd-1a1fd6fb3e8c {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:13:46 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8ee929-e2fa-4459-a824-f201783f9f19]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:47 devstack sudo[83154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c Apr 24 19:13:47 devstack sudo[83154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:48 devstack sudo[83154]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" returned: 0 in 1.184s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:48 devstack sudo[83170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 1G Apr 24 19:13:48 devstack sudo[83170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:49 devstack sudo[83170]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 1G" returned: 0 in 0.944s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:49 devstack sudo[83182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 Apr 24 19:13:49 devstack sudo[83182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:49 devstack sudo[83182]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3" returned: 0 in 0.775s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:49 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 is being set with open permissions: ugo+rw Apr 24 19:13:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:49 devstack sudo[83187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 Apr 24 19:13:49 devstack sudo[83187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:50 devstack sudo[83187]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3" returned: 0 in 0.660s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:50 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=56,cinder:UPDATE=56,cinder:DELETE=6,cinder:INSERT=16 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:13:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:50 devstack sudo[83190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.info Apr 24 19:13:50 devstack sudo[83190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:51 devstack sudo[83190]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.info" returned: 0 in 0.653s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:51 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.info is being set with open permissions: ugo+rw Apr 24 19:13:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:51 devstack sudo[83193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.info Apr 24 19:13:51 devstack sudo[83193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:51 devstack sudo[83193]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.info" returned: 0 in 0.560s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.915s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:51 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-737b7739-4a56-4fca-84ba-b168a437f8a0 req-de12ef10-9743-43d2-8831-c993ece53800 tempest-VolumesSnapshotsTestJSON-512408972 None] Create snapshot completed successfully Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Acquiring lock "cinder-99a90ef8-9d7e-4796-84d3-abebf3279fe3-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-99a90ef8-9d7e-4796-84d3-abebf3279fe3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Acquiring lock "cinder-quobyte-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-quobyte-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Acquiring lock "cinder-quobyte-99a90ef8-9d7e-4796-84d3-abebf3279fe3" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-quobyte-99a90ef8-9d7e-4796-84d3-abebf3279fe3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Deleting offline snapshot 99a90ef8-9d7e-4796-84d3-abebf3279fe3 of volume fbba16ec-a424-4974-89cd-1a1fd6fb3e8c {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] snapshot_file for this snap is: volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3a6173-00d9-49e0-a59a-baf28f2c8956]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:53 devstack sudo[83199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 Apr 24 19:13:53 devstack sudo[83199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:53 devstack sudo[83199]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3" returned: 0 in 0.675s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:13:53 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[996f62ef-5059-44e2-9f42-ff840ec1d3b2]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:53 devstack sudo[83204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c Apr 24 19:13:53 devstack sudo[83204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:54 devstack sudo[83204]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" returned: 0 in 0.632s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:54 devstack sudo[83212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 Apr 24 19:13:54 devstack sudo[83212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:55 devstack sudo[83212]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3" returned: 0 in 0.854s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:55 devstack sudo[83228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3 Apr 24 19:13:55 devstack sudo[83228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:55 devstack sudo[83228]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c.99a90ef8-9d7e-4796-84d3-abebf3279fe3" returned: 0 in 0.623s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-quobyte-99a90ef8-9d7e-4796-84d3-abebf3279fe3" released by "_delete_snapshot" :: held 3.016s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-quobyte-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" released by "delete_snapshot" :: held 3.051s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:55 devstack cinder-volume[81522]: WARNING cinder.quota [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:13:55 devstack cinder-volume[81522]: DEBUG cinder.quota [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Created reservations ['436689af-e573-4c19-9d50-a3488f71ec97', 'b56cdb2f-68a7-4096-bc39-ecef3d149e79', 'ce8430a8-6921-474c-a989-ae9308c1aa83', '497c8038-9187-4d3a-b90d-1e5763dc5776'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:56 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Delete snapshot completed successfully. Apr 24 19:13:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7edf99d7-fcc6-48d6-81ec-9253c82096d3 req-10abafbc-c575-417d-9d6a-0d2d7ac091ee tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-99a90ef8-9d7e-4796-84d3-abebf3279fe3-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Acquiring lock "cinder-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Acquiring lock "cinder-quobyte-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-quobyte-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:56 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1fe3b8-6177-4a55-80f9-d36517568264]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:56 devstack sudo[83268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c Apr 24 19:13:56 devstack sudo[83268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:57 devstack sudo[83268]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" returned: 0 in 0.993s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:57 devstack sudo[83277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c Apr 24 19:13:57 devstack sudo[83277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:58 devstack sudo[83277]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" returned: 0 in 0.711s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-quobyte-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c" released by "delete_volume" :: held 1.816s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:58 devstack cinder-volume[81522]: DEBUG cinder.quota [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Created reservations ['09039288-8c8b-4727-b7c5-5204acf36a34', '4e753085-a565-4b22-b005-73c5692d861b', '47b6fc0e-6f27-4422-9fb6-42eb810b38c3', '644fbe75-65d6-4dae-8ce4-5b25cd21fe8f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:58 devstack sudo[83280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:13:58 devstack sudo[83280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:59 devstack sudo[83280]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.841s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:59 devstack cinder-volume[81522]: DEBUG cinder.manager [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Deleted volume successfully. Apr 24 19:13:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-c5aeea20-d4f7-43dc-854e-b7dcd77921e5 req-a03f7fbd-58cf-44fc-b780-e670d29e5f19 tempest-VolumesSnapshotsTestJSON-512408972 None] Lock "cinder-fbba16ec-a424-4974-89cd-1a1fd6fb3e8c-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:00 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:UPDATE=84,cinder:SELECT=61,cinder:INSERT=17,cinder:DELETE=6 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:14:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-253e02c9-ffc1-4993-806c-fbb9016298f3 tempest-BackendsCapabilitiesAdminTestsJSON-1532081019 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7228660583496, 'free_capacity_gb': 1775.7228660583496, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81522) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 19:14:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1926a270-f0bf-45da-9b28-879df734d0f9 tempest-BackendsCapabilitiesAdminTestsJSON-1532081019 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7228660583496, 'free_capacity_gb': 1775.7228660583496, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81522) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 19:14:10 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Flow 'volume_create_manager' (8ec84f55-2c9e-420b-be88-c0d9fedcfb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6e6eed-d5e8-4f10-8c1e-8f41a7000278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6e6eed-d5e8-4f10-8c1e-8f41a7000278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-147020921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3b6b52-40c8-470b-8333-578f3fb862c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fcd294d7a412b88aa632a595fe36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:16Z,use_quota=True,user_id='967b2b3050c844ef9fc74a1bf4da2f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75fd466-fc60-4d47-8d2b-9fbbc8c2ed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75fd466-fc60-4d47-8d2b-9fbbc8c2ed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13910ea1-c8f9-4541-8a3f-12ca6263940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13910ea1-c8f9-4541-8a3f-12ca6263940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3b6b52-40c8-470b-8333-578f3fb862c2', 'volume_name': 'volume-3a3b6b52-40c8-470b-8333-578f3fb862c2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b07a8d-3b3f-4736-9c4e-f53be72d95f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b07a8d-3b3f-4736-9c4e-f53be72d95f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c5629d-eb79-4a60-9711-68450a507f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:16 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Volume 3a3b6b52-40c8-470b-8333-578f3fb862c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3b6b52-40c8-470b-8333-578f3fb862c2', 'volume_size': 1} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-147020921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3b6b52-40c8-470b-8333-578f3fb862c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fcd294d7a412b88aa632a595fe36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:16Z,use_quota=True,user_id='967b2b3050c844ef9fc74a1bf4da2f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Creating volume 3a3b6b52-40c8-470b-8333-578f3fb862c2 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:16 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:14:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:16 devstack sudo[83473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 1073741824 Apr 24 19:14:16 devstack sudo[83473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:17 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b3a908f0-6fc8-4aa8-8a74-41fb3720a644 tempest-GroupSnapshotsV319Test-2140327397 None] Group tempest-GroupSnapshotsV319Test-Group-1442196746: creating Apr 24 19:14:17 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b3a908f0-6fc8-4aa8-8a74-41fb3720a644 tempest-GroupSnapshotsV319Test-2140327397 None] Group tempest-GroupSnapshotsV319Test-Group-1442196746: created successfully Apr 24 19:14:17 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b3a908f0-6fc8-4aa8-8a74-41fb3720a644 tempest-GroupSnapshotsV319Test-2140327397 None] Create group completed successfully. Apr 24 19:14:17 devstack sudo[83473]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 1073741824" returned: 0 in 1.088s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:17 devstack sudo[83481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 Apr 24 19:14:17 devstack sudo[83481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:18 devstack sudo[83481]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2" returned: 0 in 0.722s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c5629d-eb79-4a60-9711-68450a507f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3b6b52-40c8-470b-8333-578f3fb862c2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae2e773-8202-4c56-b307-d9f856413282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:18 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Volume volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 (3a3b6b52-40c8-470b-8333-578f3fb862c2): created successfully Apr 24 19:14:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae2e773-8202-4c56-b307-d9f856413282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Flow 'volume_create_manager' (8ec84f55-2c9e-420b-be88-c0d9fedcfb52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:18 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c06ef6f6-1839-4917-b41d-057e79cf5d7e tempest-VolumesAdminNegativeTest-276323808 None] Created volume successfully. Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Flow 'volume_create_manager' (a2482dde-1d05-42b0-8992-86382654cb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36181b80-b927-4b21-ae42-bd14e2f3ff37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36181b80-b927-4b21-ae42-bd14e2f3ff37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1185410417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccb9c9cc-662d-4759-b1a2-86d0b2080560,host='devstack@QuobyteHD#QuobyteHD',id=d1bae224-1a9a-457b-9c0a-e37323813489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be89dda4f00f4a2d956eb4b929b25799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:19Z,use_quota=True,user_id='de058c33670c46c18e5d511ef2b6de14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1719b20e-3b1e-458d-9581-5b45f1b44fb6),volume_type_id=1719b20e-3b1e-458d-9581-5b45f1b44fb6)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b1ac79-cdbf-454d-858d-348ad34de1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b1ac79-cdbf-454d-858d-348ad34de1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e1d1c5-781f-429c-9605-a699e8c20490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e1d1c5-781f-429c-9605-a699e8c20490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1bae224-1a9a-457b-9c0a-e37323813489', 'volume_name': 'volume-d1bae224-1a9a-457b-9c0a-e37323813489', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b571e4c-20d9-4a62-ba3f-ff1b0903224f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b571e4c-20d9-4a62-ba3f-ff1b0903224f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9f7fab-ae9c-40a6-b2af-ae11050f73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:19 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Volume d1bae224-1a9a-457b-9c0a-e37323813489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1bae224-1a9a-457b-9c0a-e37323813489', 'volume_size': 1} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ccb9c9cc-662d-4759-b1a2-86d0b2080560,created_at=2026-04-24T17:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1185410417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccb9c9cc-662d-4759-b1a2-86d0b2080560,host='devstack@QuobyteHD#QuobyteHD',id=d1bae224-1a9a-457b-9c0a-e37323813489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be89dda4f00f4a2d956eb4b929b25799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:19Z,use_quota=True,user_id='de058c33670c46c18e5d511ef2b6de14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1719b20e-3b1e-458d-9581-5b45f1b44fb6),volume_type_id=1719b20e-3b1e-458d-9581-5b45f1b44fb6)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Creating volume d1bae224-1a9a-457b-9c0a-e37323813489 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:19 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:19 devstack sudo[83484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 1073741824 Apr 24 19:14:19 devstack sudo[83484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Acquiring lock "cinder-3a3b6b52-40c8-470b-8333-578f3fb862c2-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Lock "cinder-3a3b6b52-40c8-470b-8333-578f3fb862c2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Acquiring lock "cinder-quobyte-3a3b6b52-40c8-470b-8333-578f3fb862c2" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Lock "cinder-quobyte-3a3b6b52-40c8-470b-8333-578f3fb862c2" acquired by "delete_volume" :: waited 0.026s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[59718646-6887-4915-b093-d2ef7db8a10e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:19 devstack sudo[83488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 Apr 24 19:14:19 devstack sudo[83488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:20 devstack sudo[83484]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 1073741824" returned: 0 in 1.239s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:20 devstack sudo[83496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 Apr 24 19:14:20 devstack sudo[83496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:20 devstack sudo[83488]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2" returned: 0 in 1.160s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:20 devstack sudo[83498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2 Apr 24 19:14:20 devstack sudo[83498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:21 devstack sudo[83496]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489" returned: 0 in 0.768s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9f7fab-ae9c-40a6-b2af-ae11050f73fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1bae224-1a9a-457b-9c0a-e37323813489', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:21 devstack sudo[83501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:14:21 devstack sudo[83501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46301a3e-3fc3-43eb-9e15-c436f5d34430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:21 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Volume volume-d1bae224-1a9a-457b-9c0a-e37323813489 (d1bae224-1a9a-457b-9c0a-e37323813489): created successfully Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46301a3e-3fc3-43eb-9e15-c436f5d34430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Flow 'volume_create_manager' (a2482dde-1d05-42b0-8992-86382654cb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:21 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-bde0aff3-4fc2-4f6c-aa18-383574f20a79 tempest-GroupSnapshotsV319Test-2140327397 None] Created volume successfully. Apr 24 19:14:21 devstack sudo[83498]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a3b6b52-40c8-470b-8333-578f3fb862c2" returned: 0 in 1.136s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Lock "cinder-quobyte-3a3b6b52-40c8-470b-8333-578f3fb862c2" released by "delete_volume" :: held 2.365s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:22 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Created reservations ['b65f0bdc-7624-4dcc-bcc5-f04d9084a744', '53c54f52-de8b-4c4d-949e-6b5cf70a0a0e', '1fcf595f-5394-4256-b8a2-74efc6868568', '31b2d295-02e0-4759-b9cc-47e49db55c67'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:22 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:22 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:22 devstack sudo[83501]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.975s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:22 devstack sudo[83506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:14:22 devstack sudo[83506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:23 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] GroupSnapshot d167b0fa-2f9c-44be-a0c7-5332f6b7f56a: creating. Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Group snapshot d167b0fa-2f9c-44be-a0c7-5332f6b7f56a: creating. {{(pid=81522) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:14:23 devstack sudo[83506]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Creating offline snapshot 411e4f9d-fc7d-4a99-adfb-29351f703fcb of volume d1bae224-1a9a-457b-9c0a-e37323813489 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.156s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:23 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Deleted volume successfully. Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5701ec-8bb8-448b-897a-32c42b13b850]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7ce24d9d-2044-426b-a505-7a7e35e65e0a tempest-VolumesAdminNegativeTest-276323808 None] Lock "cinder-3a3b6b52-40c8-470b-8333-578f3fb862c2-delete_volume" released by "delete_volume" :: held 3.946s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:23 devstack sudo[83509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 Apr 24 19:14:23 devstack sudo[83509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Flow 'volume_create_manager' (b032b824-4350-4cb6-9ec8-6a3a8b05a76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419b1a52-be31-4cc2-a8ba-cb22b046f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419b1a52-be31-4cc2-a8ba-cb22b046f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1704458485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10674a91-06a7-4952-aed7-0e9d7347ff82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acb934a5eb34a91be3e5669e178b607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:24Z,use_quota=True,user_id='ba6f07ac5ddd4e988326a59d9115d002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f3ce5a-ee1a-4501-afaa-e19b1dcff7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f3ce5a-ee1a-4501-afaa-e19b1dcff7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa3d3f0-08c2-4a44-8229-d9b7393e0ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa3d3f0-08c2-4a44-8229-d9b7393e0ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10674a91-06a7-4952-aed7-0e9d7347ff82', 'volume_name': 'volume-10674a91-06a7-4952-aed7-0e9d7347ff82', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801f6e5c-06f0-4f84-b68a-692a38c66b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801f6e5c-06f0-4f84-b68a-692a38c66b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d997589f-09ee-4918-8370-d93f13fb3dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:23 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Volume 10674a91-06a7-4952-aed7-0e9d7347ff82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10674a91-06a7-4952-aed7-0e9d7347ff82', 'volume_size': 1} Apr 24 19:14:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:24 devstack sudo[83509]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489" returned: 0 in 1.058s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:24 devstack sudo[83515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb 1G Apr 24 19:14:24 devstack sudo[83515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Flow 'volume_create_manager' (f7ad20d0-7a3b-4c9e-be5c-25fd5fb01eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86553e2-d12f-487d-ac6a-1bcb8c0a2b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86553e2-d12f-487d-ac6a-1bcb8c0a2b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:24Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9049dbf5-5f75-4c6f-98c9-3a4b007c3a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228bdcebf3d94021901e00478d1b8bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:25Z,use_quota=True,user_id='cba2c5265604401284bb1052fd90d520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0f809b-521c-4609-9832-e3f1be3bdae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0f809b-521c-4609-9832-e3f1be3bdae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368d7631-0ca8-4308-bcef-d2c6968fc310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:24 devstack cinder-volume[81522]: DEBUG cinder.image.glance [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Creating Keystone auth plugin from conf {{(pid=81522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368d7631-0ca8-4308-bcef-d2c6968fc310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9049dbf5-5f75-4c6f-98c9-3a4b007c3a61', 'volume_name': 'volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261f98e5-a37f-4a42-bcca-6e329cbdbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261f98e5-a37f-4a42-bcca-6e329cbdbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5391c44-cd84-4c99-85e9-1ef2306af62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:25 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Volume 9049dbf5-5f75-4c6f-98c9-3a4b007c3a61: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Trying to clone 9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 from image 25434dbf-f589-4779-867c-1dfa660304ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]). {{(pid=81522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:14:25 devstack sudo[83515]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb 1G" returned: 0 in 1.081s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1bae224-1a9a-457b-9c0a-e37323813489 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:25 devstack sudo[83568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1bae224-1a9a-457b-9c0a-e37323813489 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb Apr 24 19:14:25 devstack sudo[83568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:14:25 devstack cinder-volume[81522]: INFO cinder.image.image_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49f00f4-7400-4ad1-ba5f-142ce8a9b580]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:25 devstack sudo[83573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD Apr 24 19:14:25 devstack sudo[83573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:26 devstack sudo[83568]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1bae224-1a9a-457b-9c0a-e37323813489 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb" returned: 0 in 0.702s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:26 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:14:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:26 devstack sudo[83579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb Apr 24 19:14:26 devstack sudo[83579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:26 devstack sudo[83573]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD" returned: 0 in 0.768s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:26 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Temporary image 25434dbf-f589-4779-867c-1dfa660304ca is fetched for user cba2c5265604401284bb1052fd90d520. {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:14:26 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ae67bc-8172-4dc7-b4e6-65753f09a26c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:26 devstack sudo[83586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD Apr 24 19:14:26 devstack sudo[83586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:26 devstack sudo[83579]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb" returned: 0 in 0.499s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:26 devstack sudo[83588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.info Apr 24 19:14:26 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:27 devstack sudo[83586]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD" returned: 0 in 0.738s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:27 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.info" returned: 0 in 0.703s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:27 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:14:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:27 devstack sudo[83597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.info Apr 24 19:14:27 devstack sudo[83597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:27 devstack sudo[83597]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.info" returned: 0 in 0.476s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.673s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.128s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1704458485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10674a91-06a7-4952-aed7-0e9d7347ff82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acb934a5eb34a91be3e5669e178b607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:24Z,use_quota=True,user_id='ba6f07ac5ddd4e988326a59d9115d002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Creating volume 10674a91-06a7-4952-aed7-0e9d7347ff82 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:28 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:28 devstack sudo[83601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82 1073741824 Apr 24 19:14:28 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:28 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-584e5272-7fda-4cd6-b4be-15f52b66e771 tempest-GroupSnapshotsV319Test-2140327397 None] group_snapshot d167b0fa-2f9c-44be-a0c7-5332f6b7f56a: created successfully Apr 24 19:14:28 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82 1073741824" returned: 0 in 0.769s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:28 devstack sudo[83606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82 Apr 24 19:14:28 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] group_snapshot d167b0fa-2f9c-44be-a0c7-5332f6b7f56a: deleting Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] group_snapshot d167b0fa-2f9c-44be-a0c7-5332f6b7f56a: deleting {{(pid=81522) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Acquiring lock "cinder-quobyte-d1bae224-1a9a-457b-9c0a-e37323813489" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "cinder-quobyte-d1bae224-1a9a-457b-9c0a-e37323813489" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Acquiring lock "cinder-quobyte-411e4f9d-fc7d-4a99-adfb-29351f703fcb" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:29 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82" returned: 0 in 0.561s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "cinder-quobyte-411e4f9d-fc7d-4a99-adfb-29351f703fcb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Deleting offline snapshot 411e4f9d-fc7d-4a99-adfb-29351f703fcb of volume d1bae224-1a9a-457b-9c0a-e37323813489 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] snapshot_file for this snap is: volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:24Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9049dbf5-5f75-4c6f-98c9-3a4b007c3a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228bdcebf3d94021901e00478d1b8bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:25Z,use_quota=True,user_id='cba2c5265604401284bb1052fd90d520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Creating volume 9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:29 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa00cc-f011-4439-9fa0-ec663c6f9760]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:29 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 1073741824 Apr 24 19:14:29 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d997589f-09ee-4918-8370-d93f13fb3dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10674a91-06a7-4952-aed7-0e9d7347ff82', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adc17ae-044a-4e23-bfd7-7771d80a72e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:29 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Volume volume-10674a91-06a7-4952-aed7-0e9d7347ff82 (10674a91-06a7-4952-aed7-0e9d7347ff82): created successfully Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adc17ae-044a-4e23-bfd7-7771d80a72e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Flow 'volume_create_manager' (b032b824-4350-4cb6-9ec8-6a3a8b05a76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:29 devstack sudo[83611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb Apr 24 19:14:29 devstack sudo[83611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ef9391b6-17c6-4cd5-ac3a-4b54b037655b tempest-VolumesTransfersV355Test-1188988154 None] Created volume successfully. Apr 24 19:14:30 devstack sudo[83611]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb" returned: 0 in 0.557s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1bae224-1a9a-457b-9c0a-e37323813489(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5934b40c-9ada-460f-a315-310c24df8943]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:30 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 1073741824" returned: 0 in 0.681s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:30 devstack sudo[83619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 Apr 24 19:14:30 devstack sudo[83619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:30 devstack sudo[83621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 Apr 24 19:14:30 devstack sudo[83621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:30 devstack sudo[83619]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489" returned: 0 in 0.628s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:30 devstack sudo[83627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb Apr 24 19:14:30 devstack sudo[83627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:30 devstack sudo[83621]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" returned: 0 in 0.591s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Attempting download of 25434dbf-f589-4779-867c-1dfa660304ca ((None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}])) to volume 9049dbf5-5f75-4c6f-98c9-3a4b007c3a61. {{(pid=81522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca21fc3-ab95-4edc-a594-6e684e645428]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0sg1eezs {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:31 devstack sudo[83629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0sg1eezs Apr 24 19:14:31 devstack sudo[83629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:31 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5efc5866-5a3e-4e33-ab3d-956dd96cfda8 tempest-VolumesTransfersV355Test-204335475 None] Transfer volume completed successfully. Apr 24 19:14:31 devstack sudo[83627]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb" returned: 0 in 0.720s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:31 devstack sudo[83634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb Apr 24 19:14:31 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:31 devstack sudo[83629]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0sg1eezs" returned: 0 in 0.679s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0sg1eezs {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:31 devstack sudo[83638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0sg1eezs Apr 24 19:14:31 devstack sudo[83638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:31 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489.411e4f9d-fc7d-4a99-adfb-29351f703fcb" returned: 0 in 0.512s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "cinder-quobyte-411e4f9d-fc7d-4a99-adfb-29351f703fcb" released by "_delete_snapshot" :: held 2.550s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Lock "cinder-quobyte-d1bae224-1a9a-457b-9c0a-e37323813489" released by "delete_snapshot" :: held 2.579s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:32 devstack cinder-volume[81522]: WARNING cinder.quota [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-883895354 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-883895354, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:32 devstack cinder-volume[81522]: WARNING cinder.quota [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-883895354 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-883895354, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] Created reservations ['95ddd686-34d2-476d-97dd-8422e5ead58a', 'a5d858e4-865d-420e-81ca-e45aecb26e2a', '5fd58c3c-04c2-4317-aabe-9255ec76d1d3', '5fb053c0-7638-4a62-a62c-c5e48593d53d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:32 devstack sudo[83638]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0sg1eezs" returned: 1 in 0.622s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0sg1eezs' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b8324d-4821-4210-8f1b-5ae663d57ed5]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:32 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6ba18f90-e40a-46e8-b4e6-613adc060fb0 tempest-GroupSnapshotsV319Test-2140327397 None] group_snapshot d167b0fa-2f9c-44be-a0c7-5332f6b7f56a: deleted successfully Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Acquiring lock "cinder-10674a91-06a7-4952-aed7-0e9d7347ff82-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Lock "cinder-10674a91-06a7-4952-aed7-0e9d7347ff82-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Acquiring lock "cinder-quobyte-10674a91-06a7-4952-aed7-0e9d7347ff82" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Lock "cinder-quobyte-10674a91-06a7-4952-aed7-0e9d7347ff82" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:32 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD Apr 24 19:14:32 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[435df916-442c-48ca-b8ac-32aba6d31193]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:32 devstack sudo[83645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82 Apr 24 19:14:32 devstack sudo[83645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:32 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD" returned: 0 in 0.601s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] 25434dbf-f589-4779-867c-1dfa660304ca was qcow2, converting to raw {{(pid=81522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:32 devstack sudo[83651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 Apr 24 19:14:32 devstack sudo[83651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Acquiring lock "cinder-quobyte-d1bae224-1a9a-457b-9c0a-e37323813489" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Lock "cinder-quobyte-d1bae224-1a9a-457b-9c0a-e37323813489" acquired by "delete_volume" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:32 devstack sudo[83645]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82" returned: 0 in 0.715s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ac252-599c-4089-9f86-eb6a7f40f672]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:33 devstack sudo[83656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82 Apr 24 19:14:33 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:33 devstack sudo[83657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 Apr 24 19:14:33 devstack sudo[83657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:33 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-10674a91-06a7-4952-aed7-0e9d7347ff82" returned: 0 in 0.706s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Lock "cinder-quobyte-10674a91-06a7-4952-aed7-0e9d7347ff82" released by "delete_volume" :: held 1.465s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Created reservations ['c9de3a5e-6a3e-4fce-b178-9937803495d8', '1cfd5787-3ae7-475d-9445-25b7ff2c1e09', '9aac2c53-5ebe-4e6b-ac5e-e415adff5d5b', 'c9884bea-f2c6-43c7-ba62-089ec384a2c8'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:33 devstack sudo[83657]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489" returned: 0 in 0.869s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:33 devstack sudo[83677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489 Apr 24 19:14:33 devstack sudo[83677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:34 devstack sudo[83679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:14:34 devstack sudo[83679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:34 devstack sudo[83677]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d1bae224-1a9a-457b-9c0a-e37323813489" returned: 0 in 0.718s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Lock "cinder-quobyte-d1bae224-1a9a-457b-9c0a-e37323813489" released by "delete_volume" :: held 1.657s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:34 devstack sudo[83679]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.694s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:34 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Deleted volume successfully. Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d63a9996-60c2-4de4-88fc-95a6c92d0f67 tempest-VolumesTransfersV355Test-964907118 None] Lock "cinder-10674a91-06a7-4952-aed7-0e9d7347ff82-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Created reservations ['aed627ac-a71a-4506-af0f-2b2c8cb76fdb'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:34 devstack sudo[83651]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" returned: 0 in 1.967s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_blf_u171devstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:14:34 devstack cinder-volume[81522]: INFO cinder.image.image_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Converted 112.00 MB image at 56.92 MB/s Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:34 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 1G Apr 24 19:14:34 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:34 devstack cinder-volume[81522]: WARNING cinder.quota [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-883895354 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-883895354, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Created reservations ['65d5fc2f-b91e-4815-80f5-a02069f8c9e9', '7873fca0-8ebc-494a-a691-31d3f2b1730f', '1c3429b4-2716-4ca8-8faf-9f031460632f', 'db5407e5-40a1-4a01-99aa-9e20ae3433b7'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Flow 'volume_create_manager' (6c3955b3-5680-4cb4-a753-6f4083c277ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65314e20-97fe-4e7c-819e-8bd13f2a549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65314e20-97fe-4e7c-819e-8bd13f2a549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-854197886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3deecf-dcf2-49a9-a4b7-756f97c9f26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acb934a5eb34a91be3e5669e178b607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:35Z,use_quota=True,user_id='ba6f07ac5ddd4e988326a59d9115d002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bf1b2c-737d-4f5c-a317-a059954abb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bf1b2c-737d-4f5c-a317-a059954abb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fefc74-7d46-451c-9443-304b53fe5fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fefc74-7d46-451c-9443-304b53fe5fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3deecf-dcf2-49a9-a4b7-756f97c9f26e', 'volume_name': 'volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2de66a7-78cb-40e9-b2fd-983e91bab25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2de66a7-78cb-40e9-b2fd-983e91bab25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c29c9c7-f3c9-453f-bfc3-326e25193359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:35 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Volume ba3deecf-dcf2-49a9-a4b7-756f97c9f26e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e', 'volume_size': 1} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-854197886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3deecf-dcf2-49a9-a4b7-756f97c9f26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acb934a5eb34a91be3e5669e178b607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:35Z,use_quota=True,user_id='ba6f07ac5ddd4e988326a59d9115d002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Creating volume ba3deecf-dcf2-49a9-a4b7-756f97c9f26e {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:35 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:35 devstack sudo[83685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e 1073741824 Apr 24 19:14:35 devstack sudo[83685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:35 devstack sudo[83687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:14:35 devstack sudo[83687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:35 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 1G" returned: 0 in 0.776s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7b8fdd-5981-45bf-9563-c92213862ed4]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:35 devstack sudo[83693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 Apr 24 19:14:35 devstack sudo[83693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:35 devstack sudo[83687]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.765s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:35 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:35 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-3dbf282a-a34f-4cbf-87e5-b42eb3cf2adb tempest-GroupSnapshotsV319Test-2140327397 None] Delete group completed successfully. Apr 24 19:14:36 devstack sudo[83685]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e 1073741824" returned: 0 in 1.007s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:36 devstack sudo[83699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e Apr 24 19:14:36 devstack sudo[83699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:36 devstack sudo[83693]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" returned: 0 in 0.748s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:36 devstack sudo[83703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 Apr 24 19:14:36 devstack sudo[83703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:36 devstack sudo[83699]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e" returned: 0 in 0.593s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c29c9c7-f3c9-453f-bfc3-326e25193359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfb51b6-9b24-4118-a2c4-ba3b17fb7b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:36 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Volume volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e (ba3deecf-dcf2-49a9-a4b7-756f97c9f26e): created successfully Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfb51b6-9b24-4118-a2c4-ba3b17fb7b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Flow 'volume_create_manager' (6c3955b3-5680-4cb4-a753-6f4083c277ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:36 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-38e5ca4b-d1f2-4bd6-b2a8-22601f0c5b1a tempest-VolumesTransfersV355Test-1188988154 None] Created volume successfully. Apr 24 19:14:37 devstack sudo[83703]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" returned: 1 in 0.682s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Downloaded image 25434dbf-f589-4779-867c-1dfa660304ca ((None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}])) to volume 9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 successfully. {{(pid=81522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Temporary image 25434dbf-f589-4779-867c-1dfa660304ca for user cba2c5265604401284bb1052fd90d520 is deleted. {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Marking volume 9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 as bootable. {{(pid=81522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Copying metadata from image 25434dbf-f589-4779-867c-1dfa660304ca to 9049dbf5-5f75-4c6f-98c9-3a4b007c3a61. {{(pid=81522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Creating volume glance metadata for volume 9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 backed by image 25434dbf-f589-4779-867c-1dfa660304ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5391c44-cd84-4c99-85e9-1ef2306af62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f79aeb-2b16-4289-b66b-6629c3d4e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:37 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Volume volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 (9049dbf5-5f75-4c6f-98c9-3a4b007c3a61): created successfully Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f79aeb-2b16-4289-b66b-6629c3d4e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Flow 'volume_create_manager' (f7ad20d0-7a3b-4c9e-be5c-25fd5fb01eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:37 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-ed1e2e67-d6ca-453f-a927-76a4da0ad6c9 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Created volume successfully. Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Acquiring lock "cinder-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Lock "cinder-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Acquiring lock "cinder-quobyte-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Lock "cinder-quobyte-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2e5a32-0a7e-4866-8d8d-9df06a0a05cb]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:37 devstack sudo[83710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e Apr 24 19:14:37 devstack sudo[83710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:38 devstack sudo[83710]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e" returned: 0 in 0.638s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:38 devstack sudo[83716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e Apr 24 19:14:38 devstack sudo[83716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:38 devstack sudo[83716]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e" returned: 0 in 0.502s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Lock "cinder-quobyte-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e" released by "delete_volume" :: held 1.187s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Created reservations ['1c18ecaa-f8cc-4612-baf4-42a294ab4cd5', 'ed190e27-7771-4f33-8fa9-0b110562fd8d', 'b331e5de-bffb-4b53-bd60-b84db932429b', '1115c78c-8780-48a6-87c2-830b7a40115b'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:38 devstack sudo[83719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:14:38 devstack sudo[83719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:39 devstack sudo[83719]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.656s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:39 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:39 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Deleted volume successfully. Apr 24 19:14:39 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-27924b7d-d4ac-42ba-beb9-89cfaac72b93 tempest-VolumesTransfersV355Test-964907118 None] Lock "cinder-ba3deecf-dcf2-49a9-a4b7-756f97c9f26e-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e22cee-1d46-4038-922b-1ca12d6b630e]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:40 devstack sudo[83740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 Apr 24 19:14:40 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:41 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" returned: 0 in 0.718s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:41 devstack sudo[83744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 Apr 24 19:14:41 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:42 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d5742d75-65e3-4073-9f7a-ee21dd3801fb tempest-GroupsTest-1110574979 None] Group tempest-Group1-1607384737: creating Apr 24 19:14:42 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d5742d75-65e3-4073-9f7a-ee21dd3801fb tempest-GroupsTest-1110574979 None] Group tempest-Group1-1607384737: created successfully Apr 24 19:14:42 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d5742d75-65e3-4073-9f7a-ee21dd3801fb tempest-GroupsTest-1110574979 None] Create group completed successfully. Apr 24 19:14:42 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" returned: 1 in 0.847s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:14:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.621s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e', 'name': 'volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1aae27ea-e780-4976-9aad-7ff4f58597ea', 'enforce_multipath': True} {{(pid=81522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:14:42 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-bb8e1d93-2fc4-4d23-9eba-a398d9a8d59d req-724a8d46-8ccf-4e99-b7f2-b5500232329c tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] attachment_update completed successfully. Apr 24 19:14:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9cb0db55-a0a1-4753-a209-7e26f5bb82bd tempest-GroupsTest-1110574979 None] Group tempest-Group2-1325492376: creating Apr 24 19:14:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9cb0db55-a0a1-4753-a209-7e26f5bb82bd tempest-GroupsTest-1110574979 None] Group tempest-Group2-1325492376: created successfully Apr 24 19:14:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9cb0db55-a0a1-4753-a209-7e26f5bb82bd tempest-GroupsTest-1110574979 None] Create group completed successfully. Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Flow 'volume_create_manager' (e9fe2201-5b50-4437-b663-74cdf50acfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a0aeee-bb6b-4c51-b6d6-2f60ba043abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a0aeee-bb6b-4c51-b6d6-2f60ba043abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-85578643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c493b5a4-94f4-4ca1-b931-2b6a83ac50b8,host='devstack@QuobyteHD#QuobyteHD',id=8f4495bc-1108-4788-98d4-5dc79f433ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6532e879b141998303d3173e98202b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:45Z,use_quota=True,user_id='fe52963dea6f44e3a42735c8f6c2964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b28bb8bb-b066-4b67-b63b-1a612dd11cb6),volume_type_id=b28bb8bb-b066-4b67-b63b-1a612dd11cb6)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff51bc4-a227-497c-8f7b-a82b9a9d464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff51bc4-a227-497c-8f7b-a82b9a9d464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f42173f-965a-4fb4-a671-eff08373bef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f42173f-965a-4fb4-a671-eff08373bef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4495bc-1108-4788-98d4-5dc79f433ed7', 'volume_name': 'volume-8f4495bc-1108-4788-98d4-5dc79f433ed7', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370cbe5d-8980-495f-afe2-c88c5ea4be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370cbe5d-8980-495f-afe2-c88c5ea4be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaaf8be-bc28-453e-8a17-4c879574aa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:45 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Volume 8f4495bc-1108-4788-98d4-5dc79f433ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4495bc-1108-4788-98d4-5dc79f433ed7', 'volume_size': 1} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c493b5a4-94f4-4ca1-b931-2b6a83ac50b8,created_at=2026-04-24T17:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-85578643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c493b5a4-94f4-4ca1-b931-2b6a83ac50b8,host='devstack@QuobyteHD#QuobyteHD',id=8f4495bc-1108-4788-98d4-5dc79f433ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6532e879b141998303d3173e98202b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:45Z,use_quota=True,user_id='fe52963dea6f44e3a42735c8f6c2964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b28bb8bb-b066-4b67-b63b-1a612dd11cb6),volume_type_id=b28bb8bb-b066-4b67-b63b-1a612dd11cb6)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Creating volume 8f4495bc-1108-4788-98d4-5dc79f433ed7 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:45 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:14:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:45 devstack sudo[83818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 1073741824 Apr 24 19:14:45 devstack sudo[83818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:46 devstack sudo[83818]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 1073741824" returned: 0 in 0.837s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:46 devstack sudo[83827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 Apr 24 19:14:46 devstack sudo[83827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:46 devstack sudo[83827]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7" returned: 0 in 0.526s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaaf8be-bc28-453e-8a17-4c879574aa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4495bc-1108-4788-98d4-5dc79f433ed7', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5768aa0f-b2c7-485a-8962-29ec7624a87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:46 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Volume volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 (8f4495bc-1108-4788-98d4-5dc79f433ed7): created successfully Apr 24 19:14:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5768aa0f-b2c7-485a-8962-29ec7624a87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Flow 'volume_create_manager' (e9fe2201-5b50-4437-b663-74cdf50acfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:46 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-8b6e2f99-7892-4579-a5be-f201858851a0 tempest-GroupsTest-1110574979 None] Created volume successfully. Apr 24 19:14:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Acquiring lock "cinder-quobyte-8f4495bc-1108-4788-98d4-5dc79f433ed7" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Lock "cinder-quobyte-8f4495bc-1108-4788-98d4-5dc79f433ed7" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:47 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[362cea61-1ec6-4fcb-b9dc-62e1bf0a1986]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:47 devstack sudo[84150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 Apr 24 19:14:47 devstack sudo[84150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:48 devstack sudo[84150]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7" returned: 0 in 0.871s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:48 devstack sudo[84163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7 Apr 24 19:14:48 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:49 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8f4495bc-1108-4788-98d4-5dc79f433ed7" returned: 0 in 0.791s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Lock "cinder-quobyte-8f4495bc-1108-4788-98d4-5dc79f433ed7" released by "delete_volume" :: held 1.732s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:49 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Created reservations ['c964c47c-0493-40bf-ada9-dd87b3db12e8'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:49 devstack cinder-volume[81522]: WARNING cinder.quota [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1877885621 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1877885621, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:49 devstack cinder-volume[81522]: WARNING cinder.quota [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1877885621 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1877885621, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:49 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Created reservations ['70c93c04-ac3f-46e8-bb6b-53741c5d5ee0', '4a1f7bc0-59d0-4052-a300-3d5e725dde53', '38d8cbc5-7a03-4d48-8d21-64a482e0038b', 'd2079e65-f3d7-4516-9719-9731bda3a917'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:50 devstack sudo[84196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:14:50 devstack sudo[84196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Flow 'volume_create_manager' (39e15a80-7a4f-4d40-bda6-b9d637223633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baef864-d057-4fe0-b695-acbecb0f182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baef864-d057-4fe0-b695-acbecb0f182a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1313235855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a688a8d0-f60f-4dc3-be6f-22954cc2f1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a426c3fd864392bd7f148a73cb3e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:51Z,use_quota=True,user_id='c90b0e37be7140fcafe908d34f8a2514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5197b3-768d-4fa4-aead-4948ec2f7a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5197b3-768d-4fa4-aead-4948ec2f7a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c0e957-efa2-4811-b457-2b3073d33a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c0e957-efa2-4811-b457-2b3073d33a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a688a8d0-f60f-4dc3-be6f-22954cc2f1bf', 'volume_name': 'volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11102fe9-4dfb-4159-8773-83b9b8dcfc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11102fe9-4dfb-4159-8773-83b9b8dcfc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7b8c7b-7646-4cf4-a9fb-1a4cbca0a2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:50 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Volume a688a8d0-f60f-4dc3-be6f-22954cc2f1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf', 'volume_size': 1} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1313235855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a688a8d0-f60f-4dc3-be6f-22954cc2f1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a426c3fd864392bd7f148a73cb3e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:51Z,use_quota=True,user_id='c90b0e37be7140fcafe908d34f8a2514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Creating volume a688a8d0-f60f-4dc3-be6f-22954cc2f1bf {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:50 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] Created reservations ['ba4f937e-0441-49fb-a764-48b73a3874ec'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:50 devstack sudo[84199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf 1073741824 Apr 24 19:14:50 devstack sudo[84199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:50 devstack sudo[84202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:14:50 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:51 devstack sudo[84196]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.010s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:51 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:51 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-fce56e39-c92f-4304-88a5-8a4b61d35b06 tempest-GroupsTest-1110574979 None] Delete group completed successfully. Apr 24 19:14:52 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:52 devstack sudo[84199]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.294s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:52 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf 1073741824" returned: 0 in 1.470s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c2c0f92a-ca94-46f2-a217-a923a3ce7421 tempest-GroupsTest-1110574979 None] Delete group completed successfully. Apr 24 19:14:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:52 devstack sudo[84209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf Apr 24 19:14:52 devstack sudo[84209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-eb30aad9-a451-4c9d-ae3b-8b386fa308b0 tempest-GroupsTest-1110574979 None] Group tempest-GroupsTest-Group-1610219714: creating Apr 24 19:14:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-eb30aad9-a451-4c9d-ae3b-8b386fa308b0 tempest-GroupsTest-1110574979 None] Group tempest-GroupsTest-Group-1610219714: created successfully Apr 24 19:14:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-eb30aad9-a451-4c9d-ae3b-8b386fa308b0 tempest-GroupsTest-1110574979 None] Create group completed successfully. Apr 24 19:14:53 devstack sudo[84209]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf" returned: 0 in 0.866s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.444s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7b8c7b-7646-4cf4-a9fb-1a4cbca0a2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35923e12-9884-44cf-8b62-22d8e3495c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:53 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Volume volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf (a688a8d0-f60f-4dc3-be6f-22954cc2f1bf): created successfully Apr 24 19:14:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35923e12-9884-44cf-8b62-22d8e3495c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Flow 'volume_create_manager' (39e15a80-7a4f-4d40-bda6-b9d637223633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:53 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e7c458e4-77b6-4479-b8ff-8e3ef77fe10c tempest-VolumesTransfersV357Test-1234001491 None] Created volume successfully. Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Flow 'volume_create_manager' (1a363334-36d7-4daf-8dda-fd4b96aa74b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afae19f3-8b6d-4453-aa59-fb5df2813e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afae19f3-8b6d-4453-aa59-fb5df2813e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1929532700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f835981-77c3-43f9-89a9-c96b095cda7c,host='devstack@QuobyteHD#QuobyteHD',id=dfd6f8db-a2a9-4da1-856a-a1689965b8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6532e879b141998303d3173e98202b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:54Z,use_quota=True,user_id='fe52963dea6f44e3a42735c8f6c2964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73b24cf-6eec-4061-bd0f-9802ace09e4c),volume_type_id=f73b24cf-6eec-4061-bd0f-9802ace09e4c)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67916f89-4c78-4c3d-958a-f1eff507c710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67916f89-4c78-4c3d-958a-f1eff507c710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acb88eb-a242-4cf0-bbc9-9afcee9f06a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acb88eb-a242-4cf0-bbc9-9afcee9f06a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd6f8db-a2a9-4da1-856a-a1689965b8ee', 'volume_name': 'volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e68c8a-860d-4198-a2d2-02cfdf16262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e68c8a-860d-4198-a2d2-02cfdf16262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e095a5-e4c9-44fe-8114-a910e6b23866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:54 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Volume dfd6f8db-a2a9-4da1-856a-a1689965b8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee', 'volume_size': 1} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f835981-77c3-43f9-89a9-c96b095cda7c,created_at=2026-04-24T17:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1929532700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f835981-77c3-43f9-89a9-c96b095cda7c,host='devstack@QuobyteHD#QuobyteHD',id=dfd6f8db-a2a9-4da1-856a-a1689965b8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6532e879b141998303d3173e98202b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:54Z,use_quota=True,user_id='fe52963dea6f44e3a42735c8f6c2964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73b24cf-6eec-4061-bd0f-9802ace09e4c),volume_type_id=f73b24cf-6eec-4061-bd0f-9802ace09e4c)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Creating volume dfd6f8db-a2a9-4da1-856a-a1689965b8ee {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:54 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:14:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:54 devstack sudo[84213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee 1073741824 Apr 24 19:14:54 devstack sudo[84213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:55 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6703c227-d2b0-41ed-9cd7-5eab443188b0 tempest-VolumesTransfersV357Test-1359789043 None] Transfer volume completed successfully. Apr 24 19:14:55 devstack sudo[84213]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee 1073741824" returned: 0 in 1.332s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:56 devstack sudo[84218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee Apr 24 19:14:56 devstack sudo[84218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:56 devstack sudo[84218]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee" returned: 0 in 0.857s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] <== create_volume: return (2274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e095a5-e4c9-44fe-8114-a910e6b23866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a41ad1-ce99-4ee9-aaf8-cb795c30373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Acquiring lock "cinder-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:56 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Volume volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee (dfd6f8db-a2a9-4da1-856a-a1689965b8ee): created successfully Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a41ad1-ce99-4ee9-aaf8-cb795c30373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Flow 'volume_create_manager' (1a363334-36d7-4daf-8dda-fd4b96aa74b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:56 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a2b65ed4-0246-46d1-88a2-0fbdc0ffd07e tempest-GroupsTest-1110574979 None] Created volume successfully. Apr 24 19:14:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Lock "cinder-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Acquiring lock "cinder-quobyte-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Lock "cinder-quobyte-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:57 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4860278-3a23-4d6a-89ad-3c038418e804]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:57 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf Apr 24 19:14:57 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:57 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf" returned: 0 in 0.753s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:57 devstack sudo[84227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf Apr 24 19:14:57 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Flow 'volume_create_manager' (ddca0bcb-0c68-48ee-bac3-418afa21b8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d4e738-98b9-4eb9-b142-5ff80eb7e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d4e738-98b9-4eb9-b142-5ff80eb7e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-426892398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f835981-77c3-43f9-89a9-c96b095cda7c,host='devstack@QuobyteHD#QuobyteHD',id=a8b1e4f4-ca0b-46ce-89b3-0ea285010032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6532e879b141998303d3173e98202b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:58Z,use_quota=True,user_id='fe52963dea6f44e3a42735c8f6c2964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73b24cf-6eec-4061-bd0f-9802ace09e4c),volume_type_id=f73b24cf-6eec-4061-bd0f-9802ace09e4c)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:58 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345e2a7c-eb2f-40fe-b92c-ef3ca377a50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345e2a7c-eb2f-40fe-b92c-ef3ca377a50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a64a74-3a85-4e5d-b943-54627a9c577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a64a74-3a85-4e5d-b943-54627a9c577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b1e4f4-ca0b-46ce-89b3-0ea285010032', 'volume_name': 'volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88910714-8ab3-4d3a-b5f1-7cc2678e1d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88910714-8ab3-4d3a-b5f1-7cc2678e1d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691c4755-d982-4713-9933-ee5a386648a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Volume a8b1e4f4-ca0b-46ce-89b3-0ea285010032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032', 'volume_size': 1} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f835981-77c3-43f9-89a9-c96b095cda7c,created_at=2026-04-24T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-426892398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f835981-77c3-43f9-89a9-c96b095cda7c,host='devstack@QuobyteHD#QuobyteHD',id=a8b1e4f4-ca0b-46ce-89b3-0ea285010032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6532e879b141998303d3173e98202b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:58Z,use_quota=True,user_id='fe52963dea6f44e3a42735c8f6c2964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73b24cf-6eec-4061-bd0f-9802ace09e4c),volume_type_id=f73b24cf-6eec-4061-bd0f-9802ace09e4c)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Creating volume a8b1e4f4-ca0b-46ce-89b3-0ea285010032 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:58 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf" returned: 0 in 0.815s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Lock "cinder-quobyte-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf" released by "delete_volume" :: held 1.612s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:58 devstack sudo[84230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 1073741824 Apr 24 19:14:58 devstack sudo[84230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Created reservations ['eaf956f7-2359-4762-a840-332a812968ba', '4236b407-ed95-48c3-9e87-0c3b5fd2e6a8', 'b26dba9c-e3e9-40d1-9eda-922f6bb3df1f', '05c9a24b-68ac-4b91-9f83-f1fbd2b710fa'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:58 devstack sudo[84232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:14:58 devstack sudo[84232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:59 devstack sudo[84232]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.828s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:59 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Deleted volume successfully. Apr 24 19:14:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bf0bc3be-0103-4796-9a0d-cf7552c85f73 tempest-VolumesTransfersV357Test-920026248 None] Lock "cinder-a688a8d0-f60f-4dc3-be6f-22954cc2f1bf-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:59 devstack sudo[84230]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 1073741824" returned: 0 in 1.196s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:59 devstack sudo[84265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 Apr 24 19:14:59 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Flow 'volume_create_manager' (e4ef7639-0b39-4ee3-97e3-70720da2333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8214239-df12-4ac3-b80f-763df3f32d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8214239-df12-4ac3-b80f-763df3f32d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1101232996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de44414-ff79-4f35-a758-a31ff8bab4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a426c3fd864392bd7f148a73cb3e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:00Z,use_quota=True,user_id='c90b0e37be7140fcafe908d34f8a2514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed4c573-7742-477e-871e-d571de1a13cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed4c573-7742-477e-871e-d571de1a13cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1700e6bc-8d59-4e5b-8732-c9a46ed3a6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1700e6bc-8d59-4e5b-8732-c9a46ed3a6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de44414-ff79-4f35-a758-a31ff8bab4d2', 'volume_name': 'volume-7de44414-ff79-4f35-a758-a31ff8bab4d2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517b9e33-afc2-4c4e-94ab-bd2bee9dd479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517b9e33-afc2-4c4e-94ab-bd2bee9dd479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b809df5d-64eb-4282-aa2c-4a7b05cca27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:00 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Volume 7de44414-ff79-4f35-a758-a31ff8bab4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de44414-ff79-4f35-a758-a31ff8bab4d2', 'volume_size': 1} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:00 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032" returned: 0 in 0.702s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.282s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1101232996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de44414-ff79-4f35-a758-a31ff8bab4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a426c3fd864392bd7f148a73cb3e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:00Z,use_quota=True,user_id='c90b0e37be7140fcafe908d34f8a2514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Creating volume 7de44414-ff79-4f35-a758-a31ff8bab4d2 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:00 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691c4755-d982-4713-9933-ee5a386648a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c2b22e-77ee-4c2b-aa78-539c655d8b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:00 devstack sudo[84269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 1073741824 Apr 24 19:15:00 devstack sudo[84269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:00 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Volume volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 (a8b1e4f4-ca0b-46ce-89b3-0ea285010032): created successfully Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c2b22e-77ee-4c2b-aa78-539c655d8b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Flow 'volume_create_manager' (ddca0bcb-0c68-48ee-bac3-418afa21b8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:00 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-59ef7b96-6a96-4292-93eb-1eeb742d86a5 tempest-GroupsTest-1110574979 None] Created volume successfully. Apr 24 19:15:01 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-46eae146-87a0-4792-a654-f03463f31a38 tempest-GroupsTest-1110574979 None] Update group completed successfully. Apr 24 19:15:01 devstack sudo[84269]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 1073741824" returned: 0 in 1.144s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:01 devstack sudo[84297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 Apr 24 19:15:01 devstack sudo[84297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:02 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7798f6e7-8b30-4af2-8ad5-2416b63cdb22 tempest-GroupsTest-1110574979 None] Update group completed successfully. Apr 24 19:15:02 devstack sudo[84297]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2" returned: 0 in 0.822s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b809df5d-64eb-4282-aa2c-4a7b05cca27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de44414-ff79-4f35-a758-a31ff8bab4d2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6b7ca1-07bb-4e20-8172-f92c733a2de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:02 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Volume volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 (7de44414-ff79-4f35-a758-a31ff8bab4d2): created successfully Apr 24 19:15:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6b7ca1-07bb-4e20-8172-f92c733a2de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Flow 'volume_create_manager' (e4ef7639-0b39-4ee3-97e3-70720da2333f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:02 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-730dbf90-d221-41ff-9446-526a598a3990 tempest-VolumesTransfersV357Test-1234001491 None] Created volume successfully. Apr 24 19:15:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Acquiring lock "cinder-7de44414-ff79-4f35-a758-a31ff8bab4d2-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Lock "cinder-7de44414-ff79-4f35-a758-a31ff8bab4d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Acquiring lock "cinder-quobyte-7de44414-ff79-4f35-a758-a31ff8bab4d2" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Lock "cinder-quobyte-7de44414-ff79-4f35-a758-a31ff8bab4d2" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5657c1-f1e5-437c-b8e6-f3792a13d682]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:04 devstack sudo[84308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 Apr 24 19:15:04 devstack sudo[84308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Acquiring lock "cinder-quobyte-a8b1e4f4-ca0b-46ce-89b3-0ea285010032" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Lock "cinder-quobyte-a8b1e4f4-ca0b-46ce-89b3-0ea285010032" acquired by "delete_volume" :: waited 0.049s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:04 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e569df28-5d3e-4ade-91d7-033b9863e369]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:04 devstack sudo[84310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 Apr 24 19:15:04 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:04 devstack sudo[84308]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2" returned: 0 in 0.854s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:04 devstack sudo[84341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2 Apr 24 19:15:04 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:05 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032" returned: 0 in 0.779s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:05 devstack sudo[84346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032 Apr 24 19:15:05 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:05 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7de44414-ff79-4f35-a758-a31ff8bab4d2" returned: 0 in 0.759s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Lock "cinder-quobyte-7de44414-ff79-4f35-a758-a31ff8bab4d2" released by "delete_volume" :: held 1.688s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Created reservations ['af097773-252d-40fe-893c-4ea412228183', 'aeaf5ce3-b0c0-49d3-a53a-0617cfc19081', 'a6210f2a-2e44-40f8-a5f1-9e51096a8d35', 'f96c0b07-cafa-4dd6-ac25-6648935c1deb'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:05 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:15:05 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:05 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a8b1e4f4-ca0b-46ce-89b3-0ea285010032" returned: 0 in 0.775s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Lock "cinder-quobyte-a8b1e4f4-ca0b-46ce-89b3-0ea285010032" released by "delete_volume" :: held 1.618s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Acquiring lock "cinder-quobyte-dfd6f8db-a2a9-4da1-856a-a1689965b8ee" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Lock "cinder-quobyte-dfd6f8db-a2a9-4da1-856a-a1689965b8ee" acquired by "delete_volume" :: waited 0.038s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad934b1-697e-4536-9fdc-fb4f3073156b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:06 devstack sudo[84386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee Apr 24 19:15:06 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:06 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.716s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:06 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:06 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Deleted volume successfully. Apr 24 19:15:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-862f83fb-e4ca-40b3-8f6d-dd1c9f03f8ae tempest-VolumesTransfersV357Test-920026248 None] Lock "cinder-7de44414-ff79-4f35-a758-a31ff8bab4d2-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:06 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee" returned: 0 in 0.898s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:06 devstack sudo[84398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee Apr 24 19:15:06 devstack sudo[84398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:07 devstack sudo[84398]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-dfd6f8db-a2a9-4da1-856a-a1689965b8ee" returned: 0 in 0.568s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Lock "cinder-quobyte-dfd6f8db-a2a9-4da1-856a-a1689965b8ee" released by "delete_volume" :: held 1.530s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Created reservations ['6ec23fc1-b5c9-4ced-8665-38571bb15ade'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:07 devstack cinder-volume[81522]: WARNING cinder.quota [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-4319057 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-4319057, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:07 devstack cinder-volume[81522]: WARNING cinder.quota [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-4319057 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-4319057, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Created reservations ['6d6ed6c6-80bb-449a-a413-68fedb369818', '708e91c6-88f7-4c97-b0f0-340fdf9e7643', '48366ea5-5940-4aa2-90fd-5b4c2d392a63', '17c971b2-cf5e-44eb-acbc-dc50177c4825'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Created reservations ['fe4bcf95-db66-462c-bb49-c891e8f8307e', 'b3fd0ee7-1cd8-4b79-be78-e426020a6a9a', '02e909cb-c212-45d1-87ca-c09756af0f06', 'af756e78-8371-41a8-bf8c-65e0ce74ee4a'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:08 devstack sudo[84425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:15:08 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:08 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.728s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:08 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:08 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2bd1ef7b-e646-4d2f-8ceb-567577ac063a tempest-GroupsTest-1110574979 None] Delete group completed successfully. Apr 24 19:15:15 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=107,cinder:UPDATE=119,cinder:DELETE=6,cinder:INSERT=32 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:15:15 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=133,cinder:UPDATE=141,cinder:INSERT=36,cinder:DELETE=9 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:15:15 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Flow 'volume_create_manager' (1351b171-2e49-4b4b-b9d9-8fbbf81e8d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cead2a-9094-4749-9e28-881ada0b4879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cead2a-9094-4749-9e28-881ada0b4879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-56506913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ceab3ae-1db5-4b72-8a7e-881ac29c42ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b660b362794d3fbf00ccfc30fd4a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:16Z,use_quota=True,user_id='04d26343902741bd8cf632e0d3e0c4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ace680-8fb6-4f8d-9086-ba72bf5cdad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ace680-8fb6-4f8d-9086-ba72bf5cdad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb14fa7b-85d2-42e8-8d9e-b433efad77d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb14fa7b-85d2-42e8-8d9e-b433efad77d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ceab3ae-1db5-4b72-8a7e-881ac29c42ec', 'volume_name': 'volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec', 'volume_size': 2}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14a3d3e-3d19-4847-9de7-9d3a64c8be79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14a3d3e-3d19-4847-9de7-9d3a64c8be79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8306cf2a-2e4f-4055-85ab-c7ad4b1324e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:16 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Volume 7ceab3ae-1db5-4b72-8a7e-881ac29c42ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec', 'volume_size': 2} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-56506913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ceab3ae-1db5-4b72-8a7e-881ac29c42ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b660b362794d3fbf00ccfc30fd4a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:16Z,use_quota=True,user_id='04d26343902741bd8cf632e0d3e0c4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Creating volume 7ceab3ae-1db5-4b72-8a7e-881ac29c42ec {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:16 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:15:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec 2147483648 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:16 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec 2147483648 Apr 24 19:15:16 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:17 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec 2147483648" returned: 0 in 1.144s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:17 devstack sudo[84550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec Apr 24 19:15:17 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:17 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec" returned: 0 in 0.674s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8306cf2a-2e4f-4055-85ab-c7ad4b1324e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec', 'volume_size': 2}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d8c207-1ddd-4e57-9033-4605eb2b6418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:18 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Volume volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec (7ceab3ae-1db5-4b72-8a7e-881ac29c42ec): created successfully Apr 24 19:15:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d8c207-1ddd-4e57-9033-4605eb2b6418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Flow 'volume_create_manager' (1351b171-2e49-4b4b-b9d9-8fbbf81e8d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:18 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-92372455-e07e-4081-8709-68a3bdff645f tempest-VolumesCloneNegativeTest-2136937050 None] Created volume successfully. Apr 24 19:15:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Acquiring lock "cinder-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Lock "cinder-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Acquiring lock "cinder-quobyte-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Lock "cinder-quobyte-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb100c1-ba64-486d-bdb5-dfb33b4c2a32]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:19 devstack sudo[84587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec Apr 24 19:15:19 devstack sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:20 devstack sudo[84587]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec" returned: 0 in 0.930s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:20 devstack sudo[84592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec Apr 24 19:15:20 devstack sudo[84592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:15:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:21 devstack sudo[84594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:15:21 devstack sudo[84594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:21 devstack sudo[84592]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec" returned: 0 in 1.171s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Lock "cinder-quobyte-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec" released by "delete_volume" :: held 2.170s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:22 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Created reservations ['da4d81f9-0631-4a69-9d01-25435a9e77a2', '0c5291fc-e124-46b0-bfa1-b218b5fd7994', 'f4784779-012e-4c9e-a136-a757ad352442', '09d6e694-9169-40ff-8e91-8e9b7bb09493'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:22 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:22 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:22 devstack sudo[84599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:15:22 devstack sudo[84599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:22 devstack sudo[84594]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.173s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:23 devstack sudo[84599]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.943s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:23 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:23 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Deleted volume successfully. Apr 24 19:15:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-85609aa7-1b5b-4e20-a24f-7abc0d25e4b5 tempest-VolumesCloneNegativeTest-2136937050 None] Lock "cinder-7ceab3ae-1db5-4b72-8a7e-881ac29c42ec-delete_volume" released by "delete_volume" :: held 3.732s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:26 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-f5cd4a28-b976-4cfa-8d9c-294d98ddd656 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Terminate volume connection completed successfully. Apr 24 19:15:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-f5cd4a28-b976-4cfa-8d9c-294d98ddd656 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Deleting attachment 1aae27ea-e780-4976-9aad-7ff4f58597ea. {{(pid=81522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:15:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "cinder-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "cinder-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "cinder-quobyte-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "cinder-quobyte-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" acquired by "delete_volume" :: waited 0.036s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:27 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[97451372-7737-4434-b9c4-37613207f771]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:28 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 Apr 24 19:15:28 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:28 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Flow 'volume_create_manager' (ee86f533-ba10-4e6f-bbf7-79df1e8876f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768edf34-2c05-468a-9f0d-03d6469f5c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768edf34-2c05-468a-9f0d-03d6469f5c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1113697563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce079ed9-3deb-46b6-a190-3a351f437dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e667039ae7446e8467885e960acb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:29Z,use_quota=True,user_id='3354abba9ed74af99ae85e84658e2af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3670589a-4986-4cf8-af40-583b97942220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3670589a-4986-4cf8-af40-583b97942220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9e44c9-d1b4-4483-9d43-86b68a5bafc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:28 devstack cinder-volume[81522]: DEBUG cinder.image.glance [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Creating Keystone auth plugin from conf {{(pid=81522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:15:29 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" returned: 0 in 1.238s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:29 devstack sudo[84697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 Apr 24 19:15:29 devstack sudo[84697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9e44c9-d1b4-4483-9d43-86b68a5bafc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce079ed9-3deb-46b6-a190-3a351f437dca', 'volume_name': 'volume-ce079ed9-3deb-46b6-a190-3a351f437dca', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400aef38-fae1-45f3-a898-a07f322cdad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400aef38-fae1-45f3-a898-a07f322cdad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7252ee-e9ed-4e5b-a9de-d9034bb27746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:29 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Volume ce079ed9-3deb-46b6-a190-3a351f437dca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce079ed9-3deb-46b6-a190-3a351f437dca', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:15:29 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Trying to clone ce079ed9-3deb-46b6-a190-3a351f437dca from image 25434dbf-f589-4779-867c-1dfa660304ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]). {{(pid=81522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:15:30 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:15:30 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:15:30 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b74fb-49c2-419b-b789-eeaeaf727bf7]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:30 devstack sudo[84700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD Apr 24 19:15:30 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:30 devstack sudo[84697]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" returned: 1 in 1.680s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:15:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:30 devstack sudo[84705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61 Apr 24 19:15:30 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:31 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD" returned: 0 in 0.970s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:31 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Temporary image 25434dbf-f589-4779-867c-1dfa660304ca is fetched for user 3354abba9ed74af99ae85e84658e2af6. {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:15:31 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bc2ea4-e402-4d5c-8048-729686c9c10e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:31 devstack sudo[84710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD Apr 24 19:15:31 devstack sudo[84710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:32 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" returned: 0 in 1.681s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "cinder-quobyte-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61" released by "delete_volume" :: held 4.746s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG cinder.quota [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Created reservations ['642cdd53-b0f8-4944-a86c-bce828f09379', '832bc1f9-b753-4aba-b269-699249311abb', '35e202e6-7047-42c9-aebe-d57748afed72', 'ed54741a-d2c8-4f7c-bf17-725d7ee10f19'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:32 devstack sudo[84710]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD" returned: 0 in 1.380s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1113697563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce079ed9-3deb-46b6-a190-3a351f437dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e667039ae7446e8467885e960acb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:29Z,use_quota=True,user_id='3354abba9ed74af99ae85e84658e2af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Creating volume ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:32 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:15:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:32 devstack sudo[84733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca 1073741824 Apr 24 19:15:32 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:33 devstack sudo[84753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:15:33 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:34 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca 1073741824" returned: 0 in 1.832s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:34 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.520s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:34 devstack cinder-volume[81522]: DEBUG cinder.manager [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:34 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Deleted volume successfully. Apr 24 19:15:34 devstack sudo[84766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca Apr 24 19:15:34 devstack sudo[84766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-791a0087-802a-4b79-aaa9-8f2c4351c986 req-cd3b0262-8755-4007-a4fa-c9601903d748 tempest-ServerBootFromVolumeStableRescueTest-1291352660 None] Lock "cinder-9049dbf5-5f75-4c6f-98c9-3a4b007c3a61-delete_volume" released by "delete_volume" :: held 7.130s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:35 devstack sudo[84766]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca" returned: 0 in 1.101s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] <== create_volume: return (3006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:35 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Attempting download of 25434dbf-f589-4779-867c-1dfa660304ca ((None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}])) to volume ce079ed9-3deb-46b6-a190-3a351f437dca. {{(pid=81522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:15:35 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62d6e6b-b427-4806-85c7-70a3fdecc560]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0vstwoea {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:36 devstack sudo[84771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0vstwoea Apr 24 19:15:36 devstack sudo[84771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:36 devstack sudo[84771]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0vstwoea" returned: 0 in 0.698s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0vstwoea {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:36 devstack sudo[84777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0vstwoea Apr 24 19:15:36 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:37 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0vstwoea" returned: 1 in 0.826s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_0vstwoea' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:15:37 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[426d5de4-ad85-4ef2-a0b5-f0501ae11bfd]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:37 devstack sudo[84782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD Apr 24 19:15:37 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:38 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD" returned: 0 in 0.900s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:38 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] 25434dbf-f589-4779-867c-1dfa660304ca was qcow2, converting to raw {{(pid=81522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:15:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:38 devstack sudo[84787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca Apr 24 19:15:38 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Flow 'volume_create_manager' (9e11236a-122b-4bf8-bd2a-c30fe06f1cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb63850-5280-4f65-80ad-5fcbfa450f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb63850-5280-4f65-80ad-5fcbfa450f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-6540460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37592854-9046-4040-85af-0458f8cddbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fef21db094e4587a623d4f7a9105f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:41Z,use_quota=True,user_id='2b198b3a0516432893da485e2a26c61c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92bebb49-7c30-438d-b496-f70bc350f22e),volume_type_id=92bebb49-7c30-438d-b496-f70bc350f22e)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e91a19e-e671-43b5-ad65-8dddcb7da848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e91a19e-e671-43b5-ad65-8dddcb7da848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3dbb64-f7e4-474a-ae54-69a8dca3aaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:40 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3dbb64-f7e4-474a-ae54-69a8dca3aaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37592854-9046-4040-85af-0458f8cddbeb', 'volume_name': 'volume-37592854-9046-4040-85af-0458f8cddbeb', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470ff6c5-68a5-48c9-8991-9e3ef3d5a9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470ff6c5-68a5-48c9-8991-9e3ef3d5a9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832814c0-8b7d-42d7-b109-658d83a17a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:40 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Volume 37592854-9046-4040-85af-0458f8cddbeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37592854-9046-4040-85af-0458f8cddbeb', 'volume_size': 1} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-6540460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37592854-9046-4040-85af-0458f8cddbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fef21db094e4587a623d4f7a9105f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:41Z,use_quota=True,user_id='2b198b3a0516432893da485e2a26c61c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92bebb49-7c30-438d-b496-f70bc350f22e),volume_type_id=92bebb49-7c30-438d-b496-f70bc350f22e)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Creating volume 37592854-9046-4040-85af-0458f8cddbeb {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:40 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca" returned: 0 in 2.428s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_g27_p5p8devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:15:40 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Converted 112.00 MB image at 46.09 MB/s Apr 24 19:15:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:40 devstack sudo[84820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb 1073741824 Apr 24 19:15:40 devstack sudo[84820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:40 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca 1G Apr 24 19:15:40 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:41 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca 1G" returned: 0 in 0.996s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:41 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[462440b8-33b7-490b-90ac-a3aae0710c53]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:42 devstack sudo[84894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca Apr 24 19:15:42 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:42 devstack sudo[84820]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb 1073741824" returned: 0 in 1.268s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:42 devstack sudo[84898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb Apr 24 19:15:42 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:42 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca" returned: 0 in 0.822s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:42 devstack sudo[84905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca Apr 24 19:15:42 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:42 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb" returned: 0 in 0.715s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832814c0-8b7d-42d7-b109-658d83a17a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37592854-9046-4040-85af-0458f8cddbeb', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c042927-fb3f-453a-b6cf-8d4a37626a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:42 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Volume volume-37592854-9046-4040-85af-0458f8cddbeb (37592854-9046-4040-85af-0458f8cddbeb): created successfully Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c042927-fb3f-453a-b6cf-8d4a37626a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Flow 'volume_create_manager' (9e11236a-122b-4bf8-bd2a-c30fe06f1cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:42 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6487dbd6-674a-4796-888f-75c2f064f46e tempest-VolumeTypesAccessTest-1283852483 None] Created volume successfully. Apr 24 19:15:43 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca" returned: 1 in 0.807s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Downloaded image 25434dbf-f589-4779-867c-1dfa660304ca ((None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}])) to volume ce079ed9-3deb-46b6-a190-3a351f437dca successfully. {{(pid=81522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Temporary image 25434dbf-f589-4779-867c-1dfa660304ca for user 3354abba9ed74af99ae85e84658e2af6 is deleted. {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Marking volume ce079ed9-3deb-46b6-a190-3a351f437dca as bootable. {{(pid=81522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Copying metadata from image 25434dbf-f589-4779-867c-1dfa660304ca to ce079ed9-3deb-46b6-a190-3a351f437dca. {{(pid=81522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Creating volume glance metadata for volume ce079ed9-3deb-46b6-a190-3a351f437dca backed by image 25434dbf-f589-4779-867c-1dfa660304ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7252ee-e9ed-4e5b-a9de-d9034bb27746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce079ed9-3deb-46b6-a190-3a351f437dca', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1a4236-feea-437b-8fba-f9070909eeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:43 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Volume volume-ce079ed9-3deb-46b6-a190-3a351f437dca (ce079ed9-3deb-46b6-a190-3a351f437dca): created successfully Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1a4236-feea-437b-8fba-f9070909eeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Flow 'volume_create_manager' (ee86f533-ba10-4e6f-bbf7-79df1e8876f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d280b41b-a4aa-44fc-ac0e-093d9258c882 tempest-VolumesExtendTest-1118960278 None] Created volume successfully. Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Acquiring lock "cinder-37592854-9046-4040-85af-0458f8cddbeb-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Lock "cinder-37592854-9046-4040-85af-0458f8cddbeb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Acquiring lock "cinder-quobyte-37592854-9046-4040-85af-0458f8cddbeb" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Lock "cinder-quobyte-37592854-9046-4040-85af-0458f8cddbeb" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b295e7a-aa78-495d-bc68-7ae6ad02c2bd]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:44 devstack sudo[84915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb Apr 24 19:15:44 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2528be6e-d61e-42bd-959d-dd7c7d3aff04]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:44 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb" returned: 0 in 0.649s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:44 devstack sudo[84921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca Apr 24 19:15:44 devstack sudo[84921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:44 devstack sudo[84922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb Apr 24 19:15:44 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:45 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-37592854-9046-4040-85af-0458f8cddbeb" returned: 0 in 0.608s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Lock "cinder-quobyte-37592854-9046-4040-85af-0458f8cddbeb" released by "delete_volume" :: held 1.295s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:45 devstack cinder-volume[81522]: WARNING cinder.quota [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-799249530 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-799249530, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:45 devstack cinder-volume[81522]: WARNING cinder.quota [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-799249530 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-799249530, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:45 devstack sudo[84921]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca" returned: 0 in 0.784s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Created reservations ['2bc333db-4a22-4c1c-a8ab-fa929cfc1860', '73473271-1370-4c55-b29c-01ca4c33b480', 'aeb7e0e1-64cb-4270-9599-1c755a8f2c34', '556a2156-c69a-4fdc-a485-915e2730b5c5'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:45 devstack sudo[84932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca Apr 24 19:15:45 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:45 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:15:45 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:46 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca" returned: 1 in 0.597s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:15:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca 2G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:46 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.516s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:46 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:46 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Deleted volume successfully. Apr 24 19:15:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fba341e1-9f5e-45a2-8628-d28f92353a4d tempest-VolumeTypesAccessTest-1283852483 None] Lock "cinder-37592854-9046-4040-85af-0458f8cddbeb-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca 2G" returned: 0 in 0.091s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.516s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:46 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-569cf867-a2b5-4ae4-ad4d-ff217598f223 tempest-VolumesExtendTest-1118960278 None] Extend volume completed successfully. Apr 24 19:15:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Acquiring lock "cinder-ce079ed9-3deb-46b6-a190-3a351f437dca-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Lock "cinder-ce079ed9-3deb-46b6-a190-3a351f437dca-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Acquiring lock "cinder-quobyte-ce079ed9-3deb-46b6-a190-3a351f437dca" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Lock "cinder-quobyte-ce079ed9-3deb-46b6-a190-3a351f437dca" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:47 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6254608-57bd-43cb-b122-7e910bc9c6e6]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:47 devstack sudo[84954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca Apr 24 19:15:47 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:48 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca" returned: 0 in 0.758s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:48 devstack sudo[84978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca Apr 24 19:15:48 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:49 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca" returned: 1 in 0.994s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:15:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:49 devstack sudo[84999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca Apr 24 19:15:49 devstack sudo[84999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:50 devstack sudo[84999]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce079ed9-3deb-46b6-a190-3a351f437dca" returned: 0 in 0.911s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Lock "cinder-quobyte-ce079ed9-3deb-46b6-a190-3a351f437dca" released by "delete_volume" :: held 2.775s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:50 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Created reservations ['ab4ac3c4-ebe9-448d-81e8-c5a2556146b7', '297a1c74-d321-418a-b75a-67a65a3b90e4', '1fc666c3-d277-4ff6-89c6-1be9b2c30b82', 'b2967c1a-fb5e-49e0-a77f-2d352e830507'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:50 devstack sudo[85003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:15:50 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:51 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Flow 'volume_create_manager' (1cb738f0-95ea-4556-b42c-dbbc4e851777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932fd53f-d9e4-44c2-a623-f1c3e42563cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.301s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932fd53f-d9e4-44c2-a623-f1c3e42563cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1488258766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be723e6d-11ee-4586-8e12-93346121fe24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e667039ae7446e8467885e960acb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:52Z,use_quota=True,user_id='3354abba9ed74af99ae85e84658e2af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe821ed-33e3-48b4-b4b4-0af7587a198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe821ed-33e3-48b4-b4b4-0af7587a198d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0113d1-5331-4d33-b7ae-4182a6e9aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0113d1-5331-4d33-b7ae-4182a6e9aeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be723e6d-11ee-4586-8e12-93346121fe24', 'volume_name': 'volume-be723e6d-11ee-4586-8e12-93346121fe24', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcc91f6-5a2e-47bc-9b24-d028ad57f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcc91f6-5a2e-47bc-9b24-d028ad57f808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606b30ff-2dd0-4d66-a26e-972d38ed1c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:51 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Volume be723e6d-11ee-4586-8e12-93346121fe24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be723e6d-11ee-4586-8e12-93346121fe24', 'volume_size': 1} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1488258766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be723e6d-11ee-4586-8e12-93346121fe24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e667039ae7446e8467885e960acb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:52Z,use_quota=True,user_id='3354abba9ed74af99ae85e84658e2af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Creating volume be723e6d-11ee-4586-8e12-93346121fe24 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:51 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:51 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Deleted volume successfully. Apr 24 19:15:51 devstack sudo[85008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 1073741824 Apr 24 19:15:51 devstack sudo[85008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d70643d8-d1af-40fc-8589-1b302b9224c5 tempest-VolumesExtendTest-1118960278 None] Lock "cinder-ce079ed9-3deb-46b6-a190-3a351f437dca-delete_volume" released by "delete_volume" :: held 4.552s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:53 devstack sudo[85008]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 1073741824" returned: 0 in 1.234s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:53 devstack sudo[85014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 Apr 24 19:15:53 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:54 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24" returned: 0 in 1.053s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606b30ff-2dd0-4d66-a26e-972d38ed1c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be723e6d-11ee-4586-8e12-93346121fe24', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6a521c-8077-49d3-a600-51d282bd2034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:54 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Volume volume-be723e6d-11ee-4586-8e12-93346121fe24 (be723e6d-11ee-4586-8e12-93346121fe24): created successfully Apr 24 19:15:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6a521c-8077-49d3-a600-51d282bd2034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Flow 'volume_create_manager' (1cb738f0-95ea-4556-b42c-dbbc4e851777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:54 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-1624225b-1d85-481b-8c1c-d45753184b02 tempest-VolumesExtendTest-1118960278 None] Created volume successfully. Apr 24 19:15:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Creating offline snapshot 29e30814-871b-4a75-a8b5-7bcc0e857ac8 of volume be723e6d-11ee-4586-8e12-93346121fe24 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:15:55 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[423b78cc-7740-4887-94ef-4d120e28e940]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:55 devstack sudo[85046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 Apr 24 19:15:55 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:56 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24" returned: 0 in 0.854s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:56 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 1G Apr 24 19:15:56 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:57 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 1G" returned: 0 in 0.893s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be723e6d-11ee-4586-8e12-93346121fe24 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:57 devstack sudo[85058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be723e6d-11ee-4586-8e12-93346121fe24 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 Apr 24 19:15:57 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:57 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be723e6d-11ee-4586-8e12-93346121fe24 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8" returned: 0 in 0.590s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:57 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 is being set with open permissions: ugo+rw Apr 24 19:15:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:57 devstack sudo[85064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 Apr 24 19:15:57 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:58 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8" returned: 0 in 0.529s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:58 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.info Apr 24 19:15:58 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:58 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.info" returned: 0 in 0.650s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:58 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.info is being set with open permissions: ugo+rw Apr 24 19:15:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:58 devstack sudo[85070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.info Apr 24 19:15:58 devstack sudo[85070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:59 devstack sudo[85070]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.info" returned: 0 in 0.645s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.293s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-affeaa62-a59e-4845-8270-61b8c7b7e9ee tempest-VolumesExtendTest-1118960278 None] Create snapshot completed successfully Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-adaddd32-e271-4c6e-96f6-eed1798ec229 tempest-VolumesExtendTest-1118960278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-adaddd32-e271-4c6e-96f6-eed1798ec229 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[873718c2-58c1-491f-be98-dbe7fd3ff192]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-adaddd32-e271-4c6e-96f6-eed1798ec229 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:00 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 Apr 24 19:16:00 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Flow 'volume_create_manager' (4beedfad-1478-4461-9769-90f6450864a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295470c3-686e-4cc0-a65b-dc5763dca36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295470c3-686e-4cc0-a65b-dc5763dca36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-868057013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926f14ad-15bb-472c-89b3-00b7d2dafc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f225f7d3e8244a3c9e9958d2bcb2b291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:01Z,use_quota=True,user_id='5df8049b0e1a4e51ad214cbcda980b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5ed499-ff5f-4a1b-82f7-4dcf736a4579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5ed499-ff5f-4a1b-82f7-4dcf736a4579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65122642-9682-4d07-ba05-e570f84568ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65122642-9682-4d07-ba05-e570f84568ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '926f14ad-15bb-472c-89b3-00b7d2dafc3f', 'volume_name': 'volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6574473f-c5f6-4100-a6ac-d52833a5a221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6574473f-c5f6-4100-a6ac-d52833a5a221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6c8f7a-b20e-4cc9-9ae6-0367dfe4c09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:00 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Volume 926f14ad-15bb-472c-89b3-00b7d2dafc3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f', 'volume_size': 1} Apr 24 19:16:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:01 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-adaddd32-e271-4c6e-96f6-eed1798ec229 tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24" returned: 0 in 0.795s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-adaddd32-e271-4c6e-96f6-eed1798ec229 tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 2G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-adaddd32-e271-4c6e-96f6-eed1798ec229 tempest-VolumesExtendTest-1118960278 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 2G" returned: 0 in 0.192s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-adaddd32-e271-4c6e-96f6-eed1798ec229 tempest-VolumesExtendTest-1118960278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.042s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-868057013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926f14ad-15bb-472c-89b3-00b7d2dafc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f225f7d3e8244a3c9e9958d2bcb2b291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:01Z,use_quota=True,user_id='5df8049b0e1a4e51ad214cbcda980b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Creating volume 926f14ad-15bb-472c-89b3-00b7d2dafc3f {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:01 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:01 devstack sudo[85082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f 1073741824 Apr 24 19:16:01 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:01 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-adaddd32-e271-4c6e-96f6-eed1798ec229 tempest-VolumesExtendTest-1118960278 None] Extend volume completed successfully. Apr 24 19:16:02 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f 1073741824" returned: 0 in 1.039s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:02 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f Apr 24 19:16:02 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:02 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Flow 'volume_create_manager' (34f6bfb0-5919-4648-aa90-0ac397431d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1caa17-96b9-49b9-99e3-297614eea369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1caa17-96b9-49b9-99e3-297614eea369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2022084251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670a6416-c3fc-4546-846a-1aeec71b2456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0cf042f7e9342c5aeb2faffe999aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:03Z,use_quota=True,user_id='6ac7c7dcff51406c8e7336d33495901f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f72267-698a-4bcf-ae09-e68c5467cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f72267-698a-4bcf-ae09-e68c5467cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f94eeb-a5d8-445f-acb4-2fe379d4e7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f94eeb-a5d8-445f-acb4-2fe379d4e7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670a6416-c3fc-4546-846a-1aeec71b2456', 'volume_name': 'volume-670a6416-c3fc-4546-846a-1aeec71b2456', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b400700-c3b8-492f-8dc1-9072becd55a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b400700-c3b8-492f-8dc1-9072becd55a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5267bfb5-57cb-4a99-b1d1-72e9f346f178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:03 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Volume 670a6416-c3fc-4546-846a-1aeec71b2456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670a6416-c3fc-4546-846a-1aeec71b2456', 'volume_size': 1} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Acquiring lock "cinder-29e30814-871b-4a75-a8b5-7bcc0e857ac8-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Lock "cinder-29e30814-871b-4a75-a8b5-7bcc0e857ac8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Acquiring lock "cinder-quobyte-be723e6d-11ee-4586-8e12-93346121fe24" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Lock "cinder-quobyte-be723e6d-11ee-4586-8e12-93346121fe24" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Acquiring lock "cinder-quobyte-29e30814-871b-4a75-a8b5-7bcc0e857ac8" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Lock "cinder-quobyte-29e30814-871b-4a75-a8b5-7bcc0e857ac8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Deleting offline snapshot 29e30814-871b-4a75-a8b5-7bcc0e857ac8 of volume be723e6d-11ee-4586-8e12-93346121fe24 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] snapshot_file for this snap is: volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c0f6c9-50aa-44a0-967a-7534e6824b4e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:03 devstack sudo[85089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 Apr 24 19:16:03 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:03 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f" returned: 0 in 0.616s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2022084251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670a6416-c3fc-4546-846a-1aeec71b2456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0cf042f7e9342c5aeb2faffe999aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:03Z,use_quota=True,user_id='6ac7c7dcff51406c8e7336d33495901f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Creating volume 670a6416-c3fc-4546-846a-1aeec71b2456 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:03 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6c8f7a-b20e-4cc9-9ae6-0367dfe4c09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442a8c39-978c-46a4-8d3d-3869a8dbefe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:03 devstack sudo[85092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456 1073741824 Apr 24 19:16:03 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:03 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Volume volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f (926f14ad-15bb-472c-89b3-00b7d2dafc3f): created successfully Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442a8c39-978c-46a4-8d3d-3869a8dbefe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Flow 'volume_create_manager' (4beedfad-1478-4461-9769-90f6450864a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:03 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-16ebe221-5d1a-4f93-933f-064356c543f6 tempest-ServersNegativeTestJSON-822019517 None] Created volume successfully. Apr 24 19:16:03 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8" returned: 0 in 0.625s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be723e6d-11ee-4586-8e12-93346121fe24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[636471e2-5c27-434b-8f26-f1304dff4a31]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:03 devstack sudo[85097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 Apr 24 19:16:03 devstack sudo[85097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:04 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456 1073741824" returned: 0 in 1.213s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:04 devstack sudo[85097]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24" returned: 0 in 0.983s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:04 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456 Apr 24 19:16:04 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:04 devstack sudo[85106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 Apr 24 19:16:04 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:05 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456" returned: 0 in 0.689s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5267bfb5-57cb-4a99-b1d1-72e9f346f178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670a6416-c3fc-4546-846a-1aeec71b2456', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035f170f-398f-47ff-b0ac-c9e3b33d6a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:05 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Volume volume-670a6416-c3fc-4546-846a-1aeec71b2456 (670a6416-c3fc-4546-846a-1aeec71b2456): created successfully Apr 24 19:16:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035f170f-398f-47ff-b0ac-c9e3b33d6a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Flow 'volume_create_manager' (34f6bfb0-5919-4648-aa90-0ac397431d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:05 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f960ffe9-2da1-4928-af8a-d23dce93e524 tempest-VolumesListAdminTestJSON-1241056760 None] Created volume successfully. Apr 24 19:16:05 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8" returned: 0 in 0.995s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:05 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8 Apr 24 19:16:05 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Flow 'volume_create_manager' (fb5c22ac-8204-4f76-9525-5f50a2e93f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56966d70-74e3-45d9-984b-92f08d324535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56966d70-74e3-45d9-984b-92f08d324535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-278379233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acae3d6-4c4d-4813-89a5-2046fa12f354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f225f7d3e8244a3c9e9958d2bcb2b291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:06Z,use_quota=True,user_id='5df8049b0e1a4e51ad214cbcda980b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710c0aa0-0420-48a5-a4d4-a67d0972b8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710c0aa0-0420-48a5-a4d4-a67d0972b8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b21020c-7fcc-4d4e-ac1c-66f5b5711d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b21020c-7fcc-4d4e-ac1c-66f5b5711d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5acae3d6-4c4d-4813-89a5-2046fa12f354', 'volume_name': 'volume-5acae3d6-4c4d-4813-89a5-2046fa12f354', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca02263-58b5-4c5c-a475-d6efbf4e3bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca02263-58b5-4c5c-a475-d6efbf4e3bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e851748-3eb5-406d-9e27-a18ae5c8c3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:06 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Volume 5acae3d6-4c4d-4813-89a5-2046fa12f354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5acae3d6-4c4d-4813-89a5-2046fa12f354', 'volume_size': 1} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-278379233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acae3d6-4c4d-4813-89a5-2046fa12f354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f225f7d3e8244a3c9e9958d2bcb2b291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:06Z,use_quota=True,user_id='5df8049b0e1a4e51ad214cbcda980b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Creating volume 5acae3d6-4c4d-4813-89a5-2046fa12f354 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:06 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:06 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 1073741824 Apr 24 19:16:06 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:06 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24.29e30814-871b-4a75-a8b5-7bcc0e857ac8" returned: 0 in 1.213s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Flow 'volume_create_manager' (f89572a3-3970-4bee-973d-eaa40bdd3a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cda2441-15f7-43ac-8d85-c4253508a700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Lock "cinder-quobyte-29e30814-871b-4a75-a8b5-7bcc0e857ac8" released by "_delete_snapshot" :: held 4.009s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Lock "cinder-quobyte-be723e6d-11ee-4586-8e12-93346121fe24" released by "delete_snapshot" :: held 4.078s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cda2441-15f7-43ac-8d85-c4253508a700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2090777971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b510cf8-828c-479a-b589-4247a0a00b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0cf042f7e9342c5aeb2faffe999aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:07Z,use_quota=True,user_id='6ac7c7dcff51406c8e7336d33495901f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dfc8c7-ccbc-448f-a985-fe8551468c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dfc8c7-ccbc-448f-a985-fe8551468c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734a832c-7c77-4f25-9102-a5d10d06754b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734a832c-7c77-4f25-9102-a5d10d06754b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b510cf8-828c-479a-b589-4247a0a00b22', 'volume_name': 'volume-7b510cf8-828c-479a-b589-4247a0a00b22', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a0c55b-e687-4ca8-b390-f78da907217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a0c55b-e687-4ca8-b390-f78da907217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68b2ef0-22b3-499c-b1c3-53b6b2f1c1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:07 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Volume 7b510cf8-828c-479a-b589-4247a0a00b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b510cf8-828c-479a-b589-4247a0a00b22', 'volume_size': 1} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Created reservations ['416dd31a-66af-4823-8877-7bd0fff7c355', 'a4ad95f3-cb6f-4a73-ad12-55ad9bf81a8c', '955ea1aa-affb-4412-9eeb-d22116957ce3', '646deea7-a711-4372-af54-4a9f874f20f7'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:07 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Delete snapshot completed successfully. Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f2658bf8-873e-4d10-9e0a-c7353ccbf83c tempest-VolumesExtendTest-1118960278 None] Lock "cinder-29e30814-871b-4a75-a8b5-7bcc0e857ac8-delete_snapshot" released by "delete_snapshot" :: held 4.348s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:07 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 1073741824" returned: 0 in 1.037s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:07 devstack sudo[85157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 Apr 24 19:16:07 devstack sudo[85157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:08 devstack sudo[85157]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354" returned: 0 in 0.713s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.057s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2090777971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b510cf8-828c-479a-b589-4247a0a00b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0cf042f7e9342c5aeb2faffe999aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:07Z,use_quota=True,user_id='6ac7c7dcff51406c8e7336d33495901f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Creating volume 7b510cf8-828c-479a-b589-4247a0a00b22 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:08 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:08 devstack sudo[85166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22 1073741824 Apr 24 19:16:08 devstack sudo[85166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e851748-3eb5-406d-9e27-a18ae5c8c3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5acae3d6-4c4d-4813-89a5-2046fa12f354', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9ce181-9697-42da-925e-7d5364ceb76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:08 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Volume volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 (5acae3d6-4c4d-4813-89a5-2046fa12f354): created successfully Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9ce181-9697-42da-925e-7d5364ceb76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Flow 'volume_create_manager' (fb5c22ac-8204-4f76-9525-5f50a2e93f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:08 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-323e1829-ad07-414f-a5f0-27feabb147e9 tempest-ServersNegativeTestJSON-822019517 None] Created volume successfully. Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Acquiring lock "cinder-be723e6d-11ee-4586-8e12-93346121fe24-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Lock "cinder-be723e6d-11ee-4586-8e12-93346121fe24-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Acquiring lock "cinder-quobyte-be723e6d-11ee-4586-8e12-93346121fe24" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Lock "cinder-quobyte-be723e6d-11ee-4586-8e12-93346121fe24" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6f1bec-a447-4599-a23c-e1fab44c90f0]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:08 devstack sudo[85170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 Apr 24 19:16:08 devstack sudo[85170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:09 devstack sudo[85166]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22 1073741824" returned: 0 in 1.059s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:09 devstack sudo[85175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22 Apr 24 19:16:09 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:09 devstack sudo[85170]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24" returned: 0 in 0.892s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:09 devstack sudo[85180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24 Apr 24 19:16:09 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:10 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22" returned: 0 in 0.684s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68b2ef0-22b3-499c-b1c3-53b6b2f1c1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b510cf8-828c-479a-b589-4247a0a00b22', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a1717a-5871-4dc2-b4d1-425f52cf1648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:10 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Volume volume-7b510cf8-828c-479a-b589-4247a0a00b22 (7b510cf8-828c-479a-b589-4247a0a00b22): created successfully Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a1717a-5871-4dc2-b4d1-425f52cf1648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Flow 'volume_create_manager' (f89572a3-3970-4bee-973d-eaa40bdd3a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-83d1f3fb-80f7-46bb-be13-8034ff0141de tempest-VolumesListAdminTestJSON-1241056760 None] Created volume successfully. Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "cinder-5acae3d6-4c4d-4813-89a5-2046fa12f354-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Lock "cinder-5acae3d6-4c4d-4813-89a5-2046fa12f354-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "cinder-quobyte-5acae3d6-4c4d-4813-89a5-2046fa12f354" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Lock "cinder-quobyte-5acae3d6-4c4d-4813-89a5-2046fa12f354" acquired by "delete_volume" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[697152ef-469a-4da0-8bce-6bedf43e5f3a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:10 devstack sudo[85186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 Apr 24 19:16:10 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:10 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-be723e6d-11ee-4586-8e12-93346121fe24" returned: 0 in 0.829s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Lock "cinder-quobyte-be723e6d-11ee-4586-8e12-93346121fe24" released by "delete_volume" :: held 1.791s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Created reservations ['cbf2aa39-7aaf-49b5-9d88-e968939f99ac', '3f711535-72b8-4cc6-83b8-b18b5bd8a8c8', '52ae649e-9a1f-482a-9bc4-3ec9d04df934', '7dfdf9d2-1b49-4ba5-8de1-00138bb54507'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:10 devstack sudo[85188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:10 devstack sudo[85188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:11 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354" returned: 0 in 0.910s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:11 devstack sudo[85197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354 Apr 24 19:16:11 devstack sudo[85197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:11 devstack sudo[85188]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.772s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:11 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:11 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Deleted volume successfully. Apr 24 19:16:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-75892974-0f2d-4974-a68a-093bd56db3eb tempest-VolumesExtendTest-1118960278 None] Lock "cinder-be723e6d-11ee-4586-8e12-93346121fe24-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Flow 'volume_create_manager' (78637f99-bcfd-4a03-9da8-17418bac513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80860c98-be45-4119-b792-8bf2ea59ccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80860c98-be45-4119-b792-8bf2ea59ccc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1897844193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0cf042f7e9342c5aeb2faffe999aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:12Z,use_quota=True,user_id='6ac7c7dcff51406c8e7336d33495901f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d126d2-23ee-4ec5-9c83-a60f9ac21f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d126d2-23ee-4ec5-9c83-a60f9ac21f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e8bec2-1cbe-425f-9198-284954cd2a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e8bec2-1cbe-425f-9198-284954cd2a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0', 'volume_name': 'volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:12 devstack sudo[85197]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de3cf08-9f05-4021-9c84-7230b1fd581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de3cf08-9f05-4021-9c84-7230b1fd581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92192618-10eb-4890-919a-e9896361a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:12 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Volume c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0', 'volume_size': 1} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1897844193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0cf042f7e9342c5aeb2faffe999aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:12Z,use_quota=True,user_id='6ac7c7dcff51406c8e7336d33495901f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Creating volume c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:12 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5acae3d6-4c4d-4813-89a5-2046fa12f354" returned: 0 in 1.097s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:12 devstack sudo[85208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 1073741824 Apr 24 19:16:12 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Lock "cinder-quobyte-5acae3d6-4c4d-4813-89a5-2046fa12f354" released by "delete_volume" :: held 2.080s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Created reservations ['233fd3b7-9ac7-432e-ad35-db2e2548fb23', '85a511d6-2c6d-42c7-a3b1-8c15b5764bdf', 'c76ec358-2043-40d9-acb1-7410cf04790d', '49fdc393-c337-4cef-a660-72f3713a3a17'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:12 devstack sudo[85210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:12 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:13 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.586s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:13 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Deleted volume successfully. Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6d14cc2f-a397-402d-b32d-e87a3a5d2eee tempest-ServersNegativeTestJSON-822019517 None] Lock "cinder-5acae3d6-4c4d-4813-89a5-2046fa12f354-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:13 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 1073741824" returned: 0 in 0.961s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:13 devstack sudo[85216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 Apr 24 19:16:13 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "cinder-926f14ad-15bb-472c-89b3-00b7d2dafc3f-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Lock "cinder-926f14ad-15bb-472c-89b3-00b7d2dafc3f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "cinder-quobyte-926f14ad-15bb-472c-89b3-00b7d2dafc3f" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Lock "cinder-quobyte-926f14ad-15bb-472c-89b3-00b7d2dafc3f" acquired by "delete_volume" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fdfd95-1215-4269-806f-903bc969a8c6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:13 devstack sudo[85219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f Apr 24 19:16:13 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:14 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0" returned: 0 in 0.653s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:14 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92192618-10eb-4890-919a-e9896361a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe000f3-1dd4-420b-aef3-a5ac70d790ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:14 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Volume volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 (c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0): created successfully Apr 24 19:16:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe000f3-1dd4-420b-aef3-a5ac70d790ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Flow 'volume_create_manager' (78637f99-bcfd-4a03-9da8-17418bac513d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:14 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d4a834a5-c14a-4d48-8298-205eb8cb9f9c tempest-VolumesListAdminTestJSON-1241056760 None] Created volume successfully. Apr 24 19:16:14 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f" returned: 0 in 0.806s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:14 devstack sudo[85225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f Apr 24 19:16:14 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Flow 'volume_create_manager' (dd1358fb-b82d-4776-bf4c-a834a7b5bceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c319ebea-3792-4845-bc26-68a14b4576f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c319ebea-3792-4845-bc26-68a14b4576f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1073897504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78866903-acee-460f-91a3-84cb0eff78ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d4e565a9d042c798042715ef2ddb1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:15Z,use_quota=True,user_id='b216f283d4094777a991fefd1d2b5354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d085eb-ab73-4a5f-a1f8-f6de7ec334fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d085eb-ab73-4a5f-a1f8-f6de7ec334fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde1e88e-42bc-4ffd-99b9-c25d69f67911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde1e88e-42bc-4ffd-99b9-c25d69f67911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78866903-acee-460f-91a3-84cb0eff78ae', 'volume_name': 'volume-78866903-acee-460f-91a3-84cb0eff78ae', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b35131f-ac79-4ec4-a604-8cf13fa52337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b35131f-ac79-4ec4-a604-8cf13fa52337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127198b5-777e-433a-b814-cd9e8e1f5cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Volume 78866903-acee-460f-91a3-84cb0eff78ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78866903-acee-460f-91a3-84cb0eff78ae', 'volume_size': 1} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1073897504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78866903-acee-460f-91a3-84cb0eff78ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d4e565a9d042c798042715ef2ddb1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:15Z,use_quota=True,user_id='b216f283d4094777a991fefd1d2b5354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Creating volume 78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:15 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:15 devstack sudo[85228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae 1073741824 Apr 24 19:16:15 devstack sudo[85228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Flow 'volume_create_manager' (bfa6bf9f-f262-4cd1-b1d6-7730d11a3c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b94dcd-9ed3-4d10-be1a-74c10e7384cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b94dcd-9ed3-4d10-be1a-74c10e7384cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e1ab50-5740-45cb-8714-ed52f9cac421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a580d05f254b93a7c50eb6733f801b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:15Z,use_quota=True,user_id='9ec3768ce20d4265970801bd8910da92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08835aa4-7564-4823-8a35-27b9a3d74b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08835aa4-7564-4823-8a35-27b9a3d74b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f159eea-cf10-4ba6-8bf2-3be7ab2b8e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f159eea-cf10-4ba6-8bf2-3be7ab2b8e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e1ab50-5740-45cb-8714-ed52f9cac421', 'volume_name': 'volume-56e1ab50-5740-45cb-8714-ed52f9cac421', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23ad4d6-ed2a-44fd-b498-18d77e6a77df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23ad4d6-ed2a-44fd-b498-18d77e6a77df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c0204b-05cf-4cf8-b0e1-0726765c590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Volume 56e1ab50-5740-45cb-8714-ed52f9cac421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e1ab50-5740-45cb-8714-ed52f9cac421', 'volume_size': 1} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-926f14ad-15bb-472c-89b3-00b7d2dafc3f" returned: 0 in 0.940s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Lock "cinder-quobyte-926f14ad-15bb-472c-89b3-00b7d2dafc3f" released by "delete_volume" :: held 1.787s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Created reservations ['19a649bf-7074-401c-ad23-88789b31b8c4', 'd536429d-4a9f-4eda-ab93-ef40f19261d4', '3dc6da0b-c84d-453e-84cc-9ff8ee840923', 'c3902ff1-2d87-47d5-b87e-8c9dd5012289'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:15 devstack sudo[85230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:15 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:16 devstack sudo[85228]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae 1073741824" returned: 0 in 0.949s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:16 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:UPDATE=86,cinder:SELECT=73,cinder:INSERT=31,cinder:DELETE=7 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:16:16 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=79,cinder:INSERT=24,cinder:UPDATE=110,cinder:DELETE=9 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:16:16 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.666s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:16 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:16 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Deleted volume successfully. Apr 24 19:16:16 devstack sudo[85237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae Apr 24 19:16:16 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0bd7722-c678-4b7b-9c49-655f939b8251 tempest-ServersNegativeTestJSON-822019517 None] Lock "cinder-926f14ad-15bb-472c-89b3-00b7d2dafc3f-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:17 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae" returned: 0 in 0.651s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e1ab50-5740-45cb-8714-ed52f9cac421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a580d05f254b93a7c50eb6733f801b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:15Z,use_quota=True,user_id='9ec3768ce20d4265970801bd8910da92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Creating volume 56e1ab50-5740-45cb-8714-ed52f9cac421 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:17 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:17 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421 1073741824 Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127198b5-777e-433a-b814-cd9e8e1f5cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78866903-acee-460f-91a3-84cb0eff78ae', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:17 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdd9278-0177-4310-b597-ed5773ef3c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:17 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Volume volume-78866903-acee-460f-91a3-84cb0eff78ae (78866903-acee-460f-91a3-84cb0eff78ae): created successfully Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdd9278-0177-4310-b597-ed5773ef3c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Flow 'volume_create_manager' (dd1358fb-b82d-4776-bf4c-a834a7b5bceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:17 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-894a3122-2ae5-4d69-8c41-ece560890349 tempest-VolumesSnapshotListTestJSON-43811512 None] Created volume successfully. Apr 24 19:16:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:18 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421 1073741824" returned: 0 in 1.366s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:18 devstack sudo[85287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421 Apr 24 19:16:18 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:19 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421" returned: 0 in 0.817s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.514s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Creating offline snapshot fe7635c1-2972-4ae3-b966-8a9afb344ce5 of volume 78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c0204b-05cf-4cf8-b0e1-0726765c590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e1ab50-5740-45cb-8714-ed52f9cac421', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11730838-60e6-4df0-afd2-81fab2cc823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8209cf16-978a-4b9b-ac84-c91d70f0fe8a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:19 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Volume volume-56e1ab50-5740-45cb-8714-ed52f9cac421 (56e1ab50-5740-45cb-8714-ed52f9cac421): created successfully Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11730838-60e6-4df0-afd2-81fab2cc823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Flow 'volume_create_manager' (bfa6bf9f-f262-4cd1-b1d6-7730d11a3c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:19 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-201eefd9-82dd-4b00-8c5f-ee06657971da tempest-VolumesListAdminTestJSON-1980319704 None] Created volume successfully. Apr 24 19:16:19 devstack sudo[85296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae Apr 24 19:16:19 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Acquiring lock "cinder-56e1ab50-5740-45cb-8714-ed52f9cac421-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Lock "cinder-56e1ab50-5740-45cb-8714-ed52f9cac421-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Acquiring lock "cinder-quobyte-56e1ab50-5740-45cb-8714-ed52f9cac421" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Lock "cinder-quobyte-56e1ab50-5740-45cb-8714-ed52f9cac421" acquired by "delete_volume" :: waited 0.034s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6809c0-464d-480e-87f4-d96b8bc93544]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:20 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "cinder-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:20 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:20 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "cinder-quobyte-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:20 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-quobyte-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0" acquired by "delete_volume" :: waited 0.060s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:20 devstack sudo[85301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421 Apr 24 19:16:20 devstack sudo[85301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:20 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcff68e-2392-49a4-9cf0-a5186e2b5b13]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:20 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae" returned: 0 in 1.157s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:20 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 Apr 24 19:16:20 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:20 devstack sudo[85316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 1G Apr 24 19:16:20 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:21 devstack sudo[85301]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421" returned: 0 in 1.068s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:21 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421 Apr 24 19:16:21 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:21 devstack sudo[85337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:21 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:21 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0" returned: 0 in 1.200s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:21 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0 Apr 24 19:16:21 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:21 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 1G" returned: 0 in 1.110s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78866903-acee-460f-91a3-84cb0eff78ae -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:21 devstack sudo[85341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78866903-acee-460f-91a3-84cb0eff78ae -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 Apr 24 19:16:21 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:21 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-56e1ab50-5740-45cb-8714-ed52f9cac421" returned: 0 in 0.916s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Lock "cinder-quobyte-56e1ab50-5740-45cb-8714-ed52f9cac421" released by "delete_volume" :: held 2.037s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Created reservations ['4a1eb59b-ba5f-4847-bace-72402b399e11', '62fda8de-b7ae-44e8-b8c0-f6b514b4cdde', 'a69937df-9ee3-4e21-9b90-28d8360cd425', '7321f1d1-ef32-4041-93d2-0368f6aea2f2'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:22 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0" returned: 0 in 0.786s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-quobyte-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0" released by "delete_volume" :: held 2.047s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:22 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:22 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Created reservations ['65aef163-29f2-4853-88d1-3dfabd0ce61f', '25b70f63-8d38-4840-be02-aa80b40bb9bb', '91e8a813-a80e-4e05-ad3f-003cab41a1ea', '5c47b6a2-ad2d-49a0-bdaf-220a0e6a91d3'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:22 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.289s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:22 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78866903-acee-460f-91a3-84cb0eff78ae -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5" returned: 0 in 1.069s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:22 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 is being set with open permissions: ugo+rw Apr 24 19:16:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:22 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:22 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:22 devstack sudo[85353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 Apr 24 19:16:22 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:23 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.841s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:23 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Deleted volume successfully. Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6bc7cfac-55da-4aa6-bb38-b79bc2e5508d tempest-VolumesListAdminTestJSON-1980319704 None] Lock "cinder-56e1ab50-5740-45cb-8714-ed52f9cac421-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:23 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.616s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:23 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Deleted volume successfully. Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-feec1bc1-1efd-4177-b588-88ae2f500a9f tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-c6f7b72c-6f09-4f31-b89a-6a6e61fc1df0-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:23 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5" returned: 0 in 0.713s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:23 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.info Apr 24 19:16:23 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "cinder-7b510cf8-828c-479a-b589-4247a0a00b22-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-7b510cf8-828c-479a-b589-4247a0a00b22-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "cinder-quobyte-7b510cf8-828c-479a-b589-4247a0a00b22" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-quobyte-7b510cf8-828c-479a-b589-4247a0a00b22" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f09672-1f64-4bac-989f-a63ddec2865a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:24 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22 Apr 24 19:16:24 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:24 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.info" returned: 0 in 0.674s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:24 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.info is being set with open permissions: ugo+rw Apr 24 19:16:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:24 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.info Apr 24 19:16:24 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:24 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22" returned: 0 in 0.645s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:24 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22 Apr 24 19:16:24 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:24 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.info" returned: 0 in 0.505s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.365s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:24 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-61a56fa7-91ac-492a-b796-f61f988c7fc4 tempest-VolumesSnapshotListTestJSON-43811512 None] Create snapshot completed successfully Apr 24 19:16:25 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b510cf8-828c-479a-b589-4247a0a00b22" returned: 0 in 0.622s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-quobyte-7b510cf8-828c-479a-b589-4247a0a00b22" released by "delete_volume" :: held 1.320s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Created reservations ['33ed6ebb-9d1d-49fe-a67e-6fbd82e58c9a', '4c4a9af5-f6cd-49c2-904c-f11c4e35d22c', '896e4837-1226-45a4-9cef-6fa8c28c5f60', '497dd579-f65e-46cd-819c-6529ffd5b456'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:25 devstack sudo[85384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:25 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Creating offline snapshot f39ed552-2197-4f30-a056-667202a816a2 of volume 78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d7bffd-d1ed-4d8c-a65b-9dbb781b9a29]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:25 devstack sudo[85389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 Apr 24 19:16:25 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:26 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.652s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:26 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Deleted volume successfully. Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-9fcfd446-5b6a-48ab-8a1f-bd01dad8f8d1 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-7b510cf8-828c-479a-b589-4247a0a00b22-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "cinder-670a6416-c3fc-4546-846a-1aeec71b2456-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-670a6416-c3fc-4546-846a-1aeec71b2456-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "cinder-quobyte-670a6416-c3fc-4546-846a-1aeec71b2456" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-quobyte-670a6416-c3fc-4546-846a-1aeec71b2456" acquired by "delete_volume" :: waited 0.027s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[915020f3-9d62-4669-9a30-011a713a66c1]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:26 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456 Apr 24 19:16:26 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:26 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5" returned: 0 in 0.911s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78866903-acee-460f-91a3-84cb0eff78ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:26 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 1G Apr 24 19:16:26 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:27 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456" returned: 0 in 0.721s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:27 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456 Apr 24 19:16:27 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:27 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 1G" returned: 0 in 0.912s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:27 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 Apr 24 19:16:27 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:27 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-670a6416-c3fc-4546-846a-1aeec71b2456" returned: 0 in 0.749s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-quobyte-670a6416-c3fc-4546-846a-1aeec71b2456" released by "delete_volume" :: held 1.536s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:27 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Created reservations ['4cd2c176-4d23-4359-970a-04e91887f681', '93d7cfc4-b96c-4276-8c02-41fd7a57588f', 'a54f482c-a8a1-443a-8b3c-ff1a4a12fe30', '580b19b0-7ad0-4c1f-9b6f-7fd5c6ae05d8'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:28 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:28 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:28 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2" returned: 0 in 0.869s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:28 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 is being set with open permissions: ugo+rw Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:28 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 Apr 24 19:16:28 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:28 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.876s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:28 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Deleted volume successfully. Apr 24 19:16:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba5fabb0-79f5-4055-9ec4-0f320fc79c19 tempest-VolumesListAdminTestJSON-1241056760 None] Lock "cinder-670a6416-c3fc-4546-846a-1aeec71b2456-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:29 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2" returned: 0 in 1.243s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.166s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d78671d7-e3fa-4b0e-8241-c63cd5f8512e tempest-VolumesSnapshotListTestJSON-43811512 None] Create snapshot completed successfully Apr 24 19:16:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Creating offline snapshot e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 of volume 78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:16:31 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fd75b6-2fe4-4d57-bae3-a6fbddf21a21]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:31 devstack sudo[85516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 Apr 24 19:16:31 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:33 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2" returned: 0 in 1.758s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78866903-acee-460f-91a3-84cb0eff78ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:33 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 1G Apr 24 19:16:33 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:34 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 1G" returned: 0 in 1.384s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:34 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 Apr 24 19:16:34 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:36 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98" returned: 0 in 1.123s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:36 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 is being set with open permissions: ugo+rw Apr 24 19:16:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:36 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 Apr 24 19:16:36 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:37 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98" returned: 0 in 1.794s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.370s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:37 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-28583e65-177e-4c08-bf58-211e4a4ef304 tempest-VolumesSnapshotListTestJSON-43811512 None] Create snapshot completed successfully Apr 24 19:16:38 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Flow 'volume_create_manager' (40b1e150-b575-48e4-9b65-e8c5997abe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0f812c-b393-4867-8645-591f6274c3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Flow 'volume_create_manager' (73736931-572c-401f-98f2-6691e62f5461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5719afe5-c6d2-4bca-99a9-1c9d41f207b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5719afe5-c6d2-4bca-99a9-1c9d41f207b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1270722488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b918f71-3e75-441c-bf08-6c6cdf9420d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0190c155ea8843c49b34813b1e908089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:39Z,use_quota=True,user_id='8e1c585821da4888be904a7319f6d060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2b889a-a020-4e46-ab47-a6029b3deb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2b889a-a020-4e46-ab47-a6029b3deb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13712bc-aa58-4c74-8fa5-f0e5fe89cd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13712bc-aa58-4c74-8fa5-f0e5fe89cd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b918f71-3e75-441c-bf08-6c6cdf9420d6', 'volume_name': 'volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d210b3-4414-4741-9c48-11de2a35e0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d210b3-4414-4741-9c48-11de2a35e0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc2ef06-c5ed-4334-aff8-e3a3fa1fa7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Volume 9b918f71-3e75-441c-bf08-6c6cdf9420d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6', 'volume_size': 1} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1270722488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b918f71-3e75-441c-bf08-6c6cdf9420d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0190c155ea8843c49b34813b1e908089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:39Z,use_quota=True,user_id='8e1c585821da4888be904a7319f6d060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Creating volume 9b918f71-3e75-441c-bf08-6c6cdf9420d6 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:39 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:39 devstack sudo[85543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 1073741824 Apr 24 19:16:39 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0f812c-b393-4867-8645-591f6274c3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-252466483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98269a0-5919-4713-b5a5-2bf35273b4bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ef744b15b54484e85bd960fdd30a15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:39Z,use_quota=True,user_id='06c60b6d49304186a21422a097185c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5b717b-b3b4-4531-b40e-cf705b6cdf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5b717b-b3b4-4531-b40e-cf705b6cdf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82180869-0530-42d9-935e-c6226b8c92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82180869-0530-42d9-935e-c6226b8c92b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98269a0-5919-4713-b5a5-2bf35273b4bd', 'volume_name': 'volume-e98269a0-5919-4713-b5a5-2bf35273b4bd', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884325b1-fecd-4e28-9541-e46f24892e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884325b1-fecd-4e28-9541-e46f24892e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75fa971-9e20-408a-ba55-586e396340d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:39 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Volume e98269a0-5919-4713-b5a5-2bf35273b4bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98269a0-5919-4713-b5a5-2bf35273b4bd', 'volume_size': 1} Apr 24 19:16:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-quobyte-e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Deleting offline snapshot e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 of volume 78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] snapshot_file for this snap is: volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3319d25b-9e44-4a6a-8e48-d97de50b7ddb]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:40 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 Apr 24 19:16:40 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:40 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 1073741824" returned: 0 in 1.496s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:40 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 Apr 24 19:16:40 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:41 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98" returned: 0 in 0.714s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78866903-acee-460f-91a3-84cb0eff78ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[30affc77-998b-4ae6-b38c-4dc4c8223a2a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:41 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 Apr 24 19:16:41 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:41 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6" returned: 0 in 0.676s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.267s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.021s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-252466483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98269a0-5919-4713-b5a5-2bf35273b4bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ef744b15b54484e85bd960fdd30a15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:39Z,use_quota=True,user_id='06c60b6d49304186a21422a097185c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Creating volume e98269a0-5919-4713-b5a5-2bf35273b4bd {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:41 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc2ef06-c5ed-4334-aff8-e3a3fa1fa7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:41 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd 1073741824 Apr 24 19:16:41 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324995ae-f2eb-4271-98b2-8d035b565b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:41 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Volume volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 (9b918f71-3e75-441c-bf08-6c6cdf9420d6): created successfully Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324995ae-f2eb-4271-98b2-8d035b565b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Flow 'volume_create_manager' (73736931-572c-401f-98f2-6691e62f5461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:41 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e1540d51-3869-4be4-8149-d83c1815100d tempest-SnapshotMetadataTestJSON-1251791071 None] Created volume successfully. Apr 24 19:16:41 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2" returned: 0 in 0.754s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78866903-acee-460f-91a3-84cb0eff78ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:41 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 Apr 24 19:16:41 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:42 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd 1073741824" returned: 0 in 1.026s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:42 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd Apr 24 19:16:42 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:42 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98" returned: 0 in 0.960s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:42 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98 Apr 24 19:16:42 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:43 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd" returned: 0 in 0.713s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.579s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75fa971-9e20-408a-ba55-586e396340d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98269a0-5919-4713-b5a5-2bf35273b4bd', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2e1c45-0a6f-41e8-ae35-fe45d0edfd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Creating offline snapshot 9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 of volume 9b918f71-3e75-441c-bf08-6c6cdf9420d6 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:16:43 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Volume volume-e98269a0-5919-4713-b5a5-2bf35273b4bd (e98269a0-5919-4713-b5a5-2bf35273b4bd): created successfully Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2e1c45-0a6f-41e8-ae35-fe45d0edfd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Flow 'volume_create_manager' (40b1e150-b575-48e4-9b65-e8c5997abe1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ec74a-fe5b-4909-aafb-6d58c615eef6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-e43da2d8-af46-4ef2-b353-95f276249bb0 req-d6833428-dd43-4ae4-a0f6-55578142f57e tempest-VolumesGetTestJSON-407929717 None] Created volume successfully. Apr 24 19:16:43 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98" returned: 0 in 0.623s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98" released by "_delete_snapshot" :: held 3.205s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" released by "delete_snapshot" :: held 3.253s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:43 devstack sudo[85614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 Apr 24 19:16:43 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Created reservations ['e4ca8f4c-2788-4b0d-8949-e7bb3ec98f82', '6c868a81-304e-40ca-a540-b3a43b11fd20', '90c7c9cd-b063-40fe-9a60-e8bdaaaf18b8', '2900a522-abbd-4eb6-9fbd-f7c277fa0350'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Delete snapshot completed successfully. Apr 24 19:16:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b8050233-b126-44cd-9098-a9d45044dcc0 tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-e2887ba2-c6ca-45f1-bb5a-2b72b9cc8e98-delete_snapshot" released by "delete_snapshot" :: held 3.499s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:44 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6" returned: 0 in 0.661s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:44 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 1G Apr 24 19:16:44 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-f39ed552-2197-4f30-a056-667202a816a2-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-f39ed552-2197-4f30-a056-667202a816a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-quobyte-f39ed552-2197-4f30-a056-667202a816a2" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-f39ed552-2197-4f30-a056-667202a816a2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Deleting offline snapshot f39ed552-2197-4f30-a056-667202a816a2 of volume 78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] snapshot_file for this snap is: volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a9f8bc-63af-4390-8ea9-6cefb667bd96]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:44 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 Apr 24 19:16:44 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Acquiring lock "cinder-e98269a0-5919-4713-b5a5-2bf35273b4bd-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Lock "cinder-e98269a0-5919-4713-b5a5-2bf35273b4bd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Acquiring lock "cinder-quobyte-e98269a0-5919-4713-b5a5-2bf35273b4bd" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:45 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Lock "cinder-quobyte-e98269a0-5919-4713-b5a5-2bf35273b4bd" acquired by "delete_volume" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 1G" returned: 0 in 0.975s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2d8579-7527-4883-bde2-18715e19bd15]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:45 devstack sudo[85654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 Apr 24 19:16:45 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:45 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd Apr 24 19:16:45 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:45 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2" returned: 0 in 0.702s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78866903-acee-460f-91a3-84cb0eff78ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd8fe4-82ba-4ec6-8d1c-1d49706f9377]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:45 devstack sudo[85664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 Apr 24 19:16:45 devstack sudo[85664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:45 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186" returned: 0 in 0.732s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:45 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 is being set with open permissions: ugo+rw Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:45 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd" returned: 0 in 0.734s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:45 devstack sudo[85676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 Apr 24 19:16:45 devstack sudo[85676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:45 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd Apr 24 19:16:45 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:46 devstack sudo[85664]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5" returned: 0 in 0.628s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78866903-acee-460f-91a3-84cb0eff78ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:46 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 Apr 24 19:16:46 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:46 devstack sudo[85676]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186" returned: 0 in 0.527s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:46 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e98269a0-5919-4713-b5a5-2bf35273b4bd" returned: 0 in 0.509s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Lock "cinder-quobyte-e98269a0-5919-4713-b5a5-2bf35273b4bd" released by "delete_volume" :: held 1.322s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:46 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.info Apr 24 19:16:46 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG cinder.quota [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Created reservations ['6a23b03a-02dc-4432-a573-3e569999a1a5', '804b9a4a-4b41-4515-ade1-39eb10940b9b', '8fca242a-1ff1-409a-b6f5-820ff52d13e1', 'fe5e6e3c-a852-4a73-8efd-36a2ea5a5bcc'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:46 devstack sudo[85713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:46 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:47 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2" returned: 0 in 1.007s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:47 devstack sudo[85731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2 Apr 24 19:16:47 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:47 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.info" returned: 0 in 1.105s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:47 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.info is being set with open permissions: ugo+rw Apr 24 19:16:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:47 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.info Apr 24 19:16:47 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:47 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.154s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:47 devstack cinder-volume[81522]: DEBUG cinder.manager [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:47 devstack cinder-volume[81522]: INFO cinder.volume.manager [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Deleted volume successfully. Apr 24 19:16:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [req-7a6506d2-20d9-4a84-82ca-5962c4b0c9e0 req-66d4f766-914d-4bf4-9364-4315e283e607 tempest-VolumesGetTestJSON-407929717 None] Lock "cinder-e98269a0-5919-4713-b5a5-2bf35273b4bd-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:48 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.f39ed552-2197-4f30-a056-667202a816a2" returned: 0 in 0.956s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-f39ed552-2197-4f30-a056-667202a816a2" released by "_delete_snapshot" :: held 3.509s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" released by "delete_snapshot" :: held 3.570s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:48 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Created reservations ['07a3c0c5-2aeb-4f8f-9a7f-c8f5306a9da9', 'e522e2f3-438e-4d90-b512-8a7e55cf793e', 'bdc53946-418f-421b-bd6f-ee783f335815', '3b40f849-79f0-470f-9795-d6a33b97bcbd'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:48 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.info" returned: 0 in 0.835s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.130s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:48 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d564c2e8-6394-40d1-a3a4-06937469c28a tempest-SnapshotMetadataTestJSON-1251791071 None] Create snapshot completed successfully Apr 24 19:16:48 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Delete snapshot completed successfully. Apr 24 19:16:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c6382405-304b-494e-92c1-bea43b77c2fb tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-f39ed552-2197-4f30-a056-667202a816a2-delete_snapshot" released by "delete_snapshot" :: held 3.946s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-fe7635c1-2972-4ae3-b966-8a9afb344ce5-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-fe7635c1-2972-4ae3-b966-8a9afb344ce5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" acquired by "delete_snapshot" :: waited 0.044s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-quobyte-fe7635c1-2972-4ae3-b966-8a9afb344ce5" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-fe7635c1-2972-4ae3-b966-8a9afb344ce5" acquired by "_delete_snapshot" :: waited 0.086s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Deleting offline snapshot fe7635c1-2972-4ae3-b966-8a9afb344ce5 of volume 78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] snapshot_file for this snap is: volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3183f49-47f0-4eb1-b1f2-16eb10b4d14e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:49 devstack sudo[85742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 Apr 24 19:16:49 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Flow 'volume_create_manager' (983f63be-bd40-42fd-a827-d44d0c6567a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59400b68-4a1b-4f5e-9cff-e55a2b27b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59400b68-4a1b-4f5e-9cff-e55a2b27b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2103210104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb1f4fb-d56a-4839-b88f-144c0f9907a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8c526a60be49cdbc768db6aca21923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:50Z,use_quota=True,user_id='9fc5a69900de46a9928b52fc5b38b83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c45836-e2a0-4cbc-97de-12425c0fcb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c45836-e2a0-4cbc-97de-12425c0fcb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f0035b-dc9e-4fb8-b8c7-60c415224e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f0035b-dc9e-4fb8-b8c7-60c415224e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb1f4fb-d56a-4839-b88f-144c0f9907a0', 'volume_name': 'volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eeb8c2-cb5c-4630-8fe8-0ee908e3191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eeb8c2-cb5c-4630-8fe8-0ee908e3191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7bebfd-12eb-47af-bcdc-c8732a3cbdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:50 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Volume acb1f4fb-d56a-4839-b88f-144c0f9907a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0', 'volume_size': 1} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2103210104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb1f4fb-d56a-4839-b88f-144c0f9907a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8c526a60be49cdbc768db6aca21923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:50Z,use_quota=True,user_id='9fc5a69900de46a9928b52fc5b38b83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Creating volume acb1f4fb-d56a-4839-b88f-144c0f9907a0 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:50 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:50 devstack sudo[85744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 1073741824 Apr 24 19:16:50 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Acquiring lock "cinder-9fe92d77-77b0-4ddf-9dba-d3c19dbb0186-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-9fe92d77-77b0-4ddf-9dba-d3c19dbb0186-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Acquiring lock "cinder-quobyte-9b918f71-3e75-441c-bf08-6c6cdf9420d6" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:50 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5" returned: 0 in 1.536s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78866903-acee-460f-91a3-84cb0eff78ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-quobyte-9b918f71-3e75-441c-bf08-6c6cdf9420d6" acquired by "delete_snapshot" :: waited 0.064s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Acquiring lock "cinder-quobyte-9fe92d77-77b0-4ddf-9dba-d3c19dbb0186" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[250aeebd-6cd1-4dd4-a0d5-b8bf8f05bdcb]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-quobyte-9fe92d77-77b0-4ddf-9dba-d3c19dbb0186" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Deleting offline snapshot 9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 of volume 9b918f71-3e75-441c-bf08-6c6cdf9420d6 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] snapshot_file for this snap is: volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:51 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa2815b-5899-473c-8059-ad6a1e37ccf7]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:51 devstack sudo[85752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae Apr 24 19:16:51 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:51 devstack sudo[85753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 Apr 24 19:16:51 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:51 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 1073741824" returned: 0 in 1.177s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:51 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 Apr 24 19:16:51 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:51 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae" returned: 0 in 0.972s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:51 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 Apr 24 19:16:51 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:52 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0" returned: 0 in 0.861s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7bebfd-12eb-47af-bcdc-c8732a3cbdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec46468-d8fd-46e1-8a5e-c5268bc9b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:52 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Volume volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 (acb1f4fb-d56a-4839-b88f-144c0f9907a0): created successfully Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec46468-d8fd-46e1-8a5e-c5268bc9b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:52 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Flow 'volume_create_manager' (983f63be-bd40-42fd-a827-d44d0c6567a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186" returned: 0 in 1.182s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-979da8aa-0c61-423d-ae4d-9e15a3de98c5 tempest-ServerRescueNegativeTestJSON-1370006284 None] Created volume successfully. Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc7d5f-a4c6-4a6b-9120-f4d0a69e0850]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:52 devstack sudo[85767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 Apr 24 19:16:52 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:52 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5" returned: 0 in 0.879s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:52 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5 Apr 24 19:16:52 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:52 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6" returned: 0 in 0.654s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:52 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 Apr 24 19:16:52 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:53 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae.fe7635c1-2972-4ae3-b966-8a9afb344ce5" returned: 0 in 0.837s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-fe7635c1-2972-4ae3-b966-8a9afb344ce5" released by "_delete_snapshot" :: held 4.494s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" released by "delete_snapshot" :: held 4.602s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:53 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Created reservations ['bf0a0385-5129-4d91-9c40-7b03972f27e9', 'ab42e9ae-49c5-4ab6-bb23-5c8568f09fa4', '9ac0fb14-711b-4113-a2dd-b7a7e2615d5d', '5028b576-fa0c-4656-8ef5-efca043150d1'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:53 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Delete snapshot completed successfully. Apr 24 19:16:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5bd60150-71c9-41f3-b2f5-0db5235bbdad tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-fe7635c1-2972-4ae3-b966-8a9afb344ce5-delete_snapshot" released by "delete_snapshot" :: held 4.928s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:53 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186" returned: 0 in 1.068s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:54 devstack sudo[85784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186 Apr 24 19:16:54 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:54 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6.9fe92d77-77b0-4ddf-9dba-d3c19dbb0186" returned: 0 in 0.642s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-quobyte-9fe92d77-77b0-4ddf-9dba-d3c19dbb0186" released by "_delete_snapshot" :: held 3.716s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-quobyte-9b918f71-3e75-441c-bf08-6c6cdf9420d6" released by "delete_snapshot" :: held 3.784s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:54 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Created reservations ['28426eb6-5550-4c72-903f-50eeaed99ad0', '8cf25b58-1674-4762-a1f0-4e5a2693252b', '74df1f56-b8be-4296-aee4-71986a9e9424', '9848581b-5c3e-407a-bc91-114e478ed0c3'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:54 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Delete snapshot completed successfully. Apr 24 19:16:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-872b66eb-43f1-451a-b341-0be0f6d3eadd tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-9fe92d77-77b0-4ddf-9dba-d3c19dbb0186-delete_snapshot" released by "delete_snapshot" :: held 4.055s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-78866903-acee-460f-91a3-84cb0eff78ae-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-78866903-acee-460f-91a3-84cb0eff78ae-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93862dd-3874-4e3a-9992-9bb0ce66ba32]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:55 devstack sudo[85787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae Apr 24 19:16:55 devstack sudo[85787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Acquiring lock "cinder-9b918f71-3e75-441c-bf08-6c6cdf9420d6-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-9b918f71-3e75-441c-bf08-6c6cdf9420d6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Acquiring lock "cinder-quobyte-9b918f71-3e75-441c-bf08-6c6cdf9420d6" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-quobyte-9b918f71-3e75-441c-bf08-6c6cdf9420d6" acquired by "delete_volume" :: waited 0.053s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee5f942-007a-46c5-bbfe-d646d5de9a84]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:55 devstack sudo[85789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 Apr 24 19:16:55 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:56 devstack sudo[85787]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae" returned: 0 in 1.088s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:56 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae Apr 24 19:16:56 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:56 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6" returned: 0 in 0.796s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:56 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6 Apr 24 19:16:56 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:57 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-78866903-acee-460f-91a3-84cb0eff78ae" returned: 0 in 0.722s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-quobyte-78866903-acee-460f-91a3-84cb0eff78ae" released by "delete_volume" :: held 1.972s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Created reservations ['fb129a4b-cdba-4b63-9565-659a545f72a2', '3a04898e-a9fc-43a0-9c37-b8bc46ad2935', 'ece2ed98-845e-444e-bb26-f59b7abbc061', '4bee48b1-af03-46a6-b22f-17c0f0965efd'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:57 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:57 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:57 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9b918f71-3e75-441c-bf08-6c6cdf9420d6" returned: 0 in 1.036s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-quobyte-9b918f71-3e75-441c-bf08-6c6cdf9420d6" released by "delete_volume" :: held 2.057s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:58 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.814s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Deleted volume successfully. Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Created reservations ['67787c5e-3967-4e87-b0c6-10d75a520008', '4c4ec728-5e3e-43cf-a255-a1d20ed1a346', 'b61838a0-72fd-40db-b375-bae755263b46', 'eb35c7fd-6301-4f47-be08-14f1b41caea4'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8d4332c5-2aae-4758-bcef-1a5b29f9472d tempest-VolumesSnapshotListTestJSON-43811512 None] Lock "cinder-78866903-acee-460f-91a3-84cb0eff78ae-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:58 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:16:58 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:59 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.895s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:59 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Deleted volume successfully. Apr 24 19:16:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-01644616-f38c-40dd-8836-4ad802ad286b tempest-SnapshotMetadataTestJSON-1251791071 None] Lock "cinder-9b918f71-3e75-441c-bf08-6c6cdf9420d6-delete_volume" released by "delete_volume" :: held 3.704s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f9b0c387-24f2-4b98-9038-c2602c8a86b4 tempest-GroupSnapshotsTest-1745253942 None] Group tempest-GroupSnapshotsTest-Group-107775823: creating Apr 24 19:16:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f9b0c387-24f2-4b98-9038-c2602c8a86b4 tempest-GroupSnapshotsTest-1745253942 None] Group tempest-GroupSnapshotsTest-Group-107775823: created successfully Apr 24 19:16:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f9b0c387-24f2-4b98-9038-c2602c8a86b4 tempest-GroupSnapshotsTest-1745253942 None] Create group completed successfully. Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Flow 'volume_create_manager' (2c7c4584-98c9-46b2-8519-d56a5cc3ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7691f1b1-8141-4019-8342-79642b7373d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7691f1b1-8141-4019-8342-79642b7373d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2114769394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f368a57-164a-49fe-a46a-2707d5da6193,host='devstack@QuobyteHD#QuobyteHD',id=2b7ecb48-98cf-4326-b9fa-1010e2efda6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0563fc8ce15f4c15a51f79b06eabe9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:02Z,use_quota=True,user_id='8c4550f176da4289915bc2f730b3a013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2da3ad7-fddd-4de1-8640-edfc61f40120),volume_type_id=e2da3ad7-fddd-4de1-8640-edfc61f40120)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63bf072-ea07-4c46-95fd-ed8223e3ff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63bf072-ea07-4c46-95fd-ed8223e3ff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f7c028-83ea-4062-a392-26e06f03bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f7c028-83ea-4062-a392-26e06f03bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7ecb48-98cf-4326-b9fa-1010e2efda6b', 'volume_name': 'volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89ba879-501f-48b9-a16f-338907677c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89ba879-501f-48b9-a16f-338907677c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48351946-1571-4dfb-8adf-a94d8861571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:01 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Volume 2b7ecb48-98cf-4326-b9fa-1010e2efda6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b', 'volume_size': 1} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1f368a57-164a-49fe-a46a-2707d5da6193,created_at=2026-04-24T17:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2114769394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f368a57-164a-49fe-a46a-2707d5da6193,host='devstack@QuobyteHD#QuobyteHD',id=2b7ecb48-98cf-4326-b9fa-1010e2efda6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0563fc8ce15f4c15a51f79b06eabe9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:02Z,use_quota=True,user_id='8c4550f176da4289915bc2f730b3a013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2da3ad7-fddd-4de1-8640-edfc61f40120),volume_type_id=e2da3ad7-fddd-4de1-8640-edfc61f40120)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Creating volume 2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:01 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:01 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b 1073741824 Apr 24 19:17:01 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:02 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b 1073741824" returned: 0 in 0.888s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:02 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b Apr 24 19:17:02 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:03 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" returned: 0 in 0.642s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48351946-1571-4dfb-8adf-a94d8861571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6706070-1213-4476-b789-ddeb9b08590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:03 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Volume volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b (2b7ecb48-98cf-4326-b9fa-1010e2efda6b): created successfully Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6706070-1213-4476-b789-ddeb9b08590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Flow 'volume_create_manager' (2c7c4584-98c9-46b2-8519-d56a5cc3ccce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:03 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-33751bd1-4c8f-409c-b655-3935f81088ec tempest-GroupSnapshotsTest-1745253942 None] Created volume successfully. Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Flow 'volume_create_manager' (31d08d93-57f4-43b5-bf1d-f7db67e113a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75d9735-e91c-419d-95d3-bbe12f14de4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75d9735-e91c-419d-95d3-bbe12f14de4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-755989615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f86898-9a62-43c3-ae28-ff4e97984d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea899d7755f448a4ac8dac691238e3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:04Z,use_quota=True,user_id='8522c93371904e62a5226970a758f5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effab0f5-3ead-48d3-997d-34848c1c8376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effab0f5-3ead-48d3-997d-34848c1c8376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54aa4967-4948-4f99-9eea-9b2bfe5460b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54aa4967-4948-4f99-9eea-9b2bfe5460b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f86898-9a62-43c3-ae28-ff4e97984d2b', 'volume_name': 'volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b', 'volume_size': 2}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9c640f-2577-4829-b7eb-324f93201d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9c640f-2577-4829-b7eb-324f93201d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b44cb6-effd-4f6d-9983-81f9c8a76af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:03 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Volume d8f86898-9a62-43c3-ae28-ff4e97984d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b', 'volume_size': 2} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-755989615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f86898-9a62-43c3-ae28-ff4e97984d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea899d7755f448a4ac8dac691238e3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:04Z,use_quota=True,user_id='8522c93371904e62a5226970a758f5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Creating volume d8f86898-9a62-43c3-ae28-ff4e97984d2b {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:03 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b 2147483648 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:03 devstack sudo[85911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b 2147483648 Apr 24 19:17:03 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:04 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] GroupSnapshot a512cddb-42f4-4b71-aa7c-3a098ace3023: creating. Apr 24 19:17:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Group snapshot a512cddb-42f4-4b71-aa7c-3a098ace3023: creating. {{(pid=81522) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:17:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:04 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b 2147483648" returned: 0 in 0.896s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:04 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b Apr 24 19:17:04 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Flow 'volume_create_manager' (e7c28644-1cdc-4be7-824d-5ec2fd10ae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139c77cb-76e4-4ce3-8735-63d35fd758b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139c77cb-76e4-4ce3-8735-63d35fd758b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-303511889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effc2652-9abc-460b-8a4a-5b792e03e3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94731d715a3d454fa1e343dae990f99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:05Z,use_quota=True,user_id='e8e687a5000743a3bb869a852d98029e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9642ea4-a4ee-452e-8e88-d91df9d3454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9642ea4-a4ee-452e-8e88-d91df9d3454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b612f643-80d2-40c3-b315-c14132066eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b612f643-80d2-40c3-b315-c14132066eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'effc2652-9abc-460b-8a4a-5b792e03e3b8', 'volume_name': 'volume-effc2652-9abc-460b-8a4a-5b792e03e3b8', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533aa97a-5e20-4038-8878-ed77b8e9ca57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533aa97a-5e20-4038-8878-ed77b8e9ca57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbeb047-beef-42a6-8788-6b92676d7765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:05 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Volume effc2652-9abc-460b-8a4a-5b792e03e3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-effc2652-9abc-460b-8a4a-5b792e03e3b8', 'volume_size': 1} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:05 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b" returned: 0 in 0.614s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.221s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Creating offline snapshot bbca1394-610b-4007-aa04-0039e6ebec63 of volume 2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b44cb6-effd-4f6d-9983-81f9c8a76af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b', 'volume_size': 2}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29e1ff1-f8c3-477a-adcb-cce84b979313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e14f692-2288-4d55-a5a7-12a8b06cf9b7]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:05 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Volume volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b (d8f86898-9a62-43c3-ae28-ff4e97984d2b): created successfully Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29e1ff1-f8c3-477a-adcb-cce84b979313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Flow 'volume_create_manager' (31d08d93-57f4-43b5-bf1d-f7db67e113a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:05 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e666b216-d3e6-453f-bdee-4d4e0459f536 tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Created volume successfully. Apr 24 19:17:05 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b Apr 24 19:17:05 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:06 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" returned: 0 in 0.869s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:06 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 1G Apr 24 19:17:06 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:07 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 1G" returned: 0 in 0.695s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:07 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 Apr 24 19:17:07 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:07 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63" returned: 0 in 0.567s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:07 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:17:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:07 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 Apr 24 19:17:07 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:08 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63" returned: 0 in 0.599s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:08 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.info Apr 24 19:17:08 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:08 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.info" returned: 0 in 0.483s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:08 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:17:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:08 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.info Apr 24 19:17:08 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:09 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.info" returned: 0 in 0.476s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.809s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.215s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-303511889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effc2652-9abc-460b-8a4a-5b792e03e3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94731d715a3d454fa1e343dae990f99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:05Z,use_quota=True,user_id='e8e687a5000743a3bb869a852d98029e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Creating volume effc2652-9abc-460b-8a4a-5b792e03e3b8 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:09 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:09 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 1073741824 Apr 24 19:17:09 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:09 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-95fcef3b-7251-484f-b036-cc071876ad19 tempest-GroupSnapshotsTest-1745253942 None] group_snapshot a512cddb-42f4-4b71-aa7c-3a098ace3023: created successfully Apr 24 19:17:10 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 1073741824" returned: 0 in 0.864s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:10 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 Apr 24 19:17:10 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:10 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8" returned: 0 in 0.725s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.766s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbeb047-beef-42a6-8788-6b92676d7765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effc2652-9abc-460b-8a4a-5b792e03e3b8', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd5556d-cb6a-44b1-b3d1-d46ca237f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:11 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Volume volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 (effc2652-9abc-460b-8a4a-5b792e03e3b8): created successfully Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd5556d-cb6a-44b1-b3d1-d46ca237f44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Flow 'volume_create_manager' (e7c28644-1cdc-4be7-824d-5ec2fd10ae65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Creating offline snapshot 785685b6-97d6-455d-a7f8-ab79d06b3b1a of volume d8f86898-9a62-43c3-ae28-ff4e97984d2b {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:17:11 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-745e7d60-568f-4ba5-a2f9-86b1a5faa20f tempest-AbsoluteLimitsTests-1027589014 None] Created volume successfully. Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f70de7-e7f9-48c5-a9fd-9af09eac2b00]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:11 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b Apr 24 19:17:11 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:11 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b" returned: 0 in 0.691s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a 2G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:11 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a 2G Apr 24 19:17:11 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Acquiring lock "cinder-effc2652-9abc-460b-8a4a-5b792e03e3b8-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Lock "cinder-effc2652-9abc-460b-8a4a-5b792e03e3b8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Acquiring lock "cinder-quobyte-effc2652-9abc-460b-8a4a-5b792e03e3b8" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Lock "cinder-quobyte-effc2652-9abc-460b-8a4a-5b792e03e3b8" acquired by "delete_volume" :: waited 0.026s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4876c962-e95c-4f9b-a1c7-6a7197b5cae1]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:12 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 Apr 24 19:17:12 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:12 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a 2G" returned: 0 in 0.810s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:12 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8" returned: 0 in 0.607s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:12 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a Apr 24 19:17:12 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:12 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8 Apr 24 19:17:12 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:13 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-effc2652-9abc-460b-8a4a-5b792e03e3b8" returned: 0 in 0.513s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Lock "cinder-quobyte-effc2652-9abc-460b-8a4a-5b792e03e3b8" released by "delete_volume" :: held 1.186s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:13 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a" returned: 0 in 0.599s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:13 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a is being set with open permissions: ugo+rw Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:13 devstack sudo[86104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a Apr 24 19:17:13 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Created reservations ['dbd95a39-17e3-49d4-b80a-1f060558fdf7', 'c9852eab-35f8-4eb5-bfc3-523cf52063f1', '7a0e5d2a-f9ef-4a33-8ed2-17bd0fccc88e', 'f8f5b4fc-70fe-4ad3-bb3e-8bd7bd54fd0c'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:13 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:13 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:13 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a" returned: 0 in 0.777s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:14 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.info Apr 24 19:17:14 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:14 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.918s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:14 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:14 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Deleted volume successfully. Apr 24 19:17:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3f191e8b-e5e4-4383-9584-7e0d0cf27e0b tempest-AbsoluteLimitsTests-1027589014 None] Lock "cinder-effc2652-9abc-460b-8a4a-5b792e03e3b8-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:14 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.info" returned: 0 in 0.834s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:14 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.info is being set with open permissions: ugo+rw Apr 24 19:17:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:14 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.info Apr 24 19:17:14 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Acquiring lock "cinder-acb1f4fb-d56a-4839-b88f-144c0f9907a0-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "cinder-acb1f4fb-d56a-4839-b88f-144c0f9907a0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Acquiring lock "cinder-quobyte-acb1f4fb-d56a-4839-b88f-144c0f9907a0" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "cinder-quobyte-acb1f4fb-d56a-4839-b88f-144c0f9907a0" acquired by "delete_volume" :: waited 0.054s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ba57a-ed5b-4900-9882-da85f10b93f2]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:15 devstack sudo[86149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 Apr 24 19:17:15 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:15 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.info" returned: 0 in 0.896s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.792s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.109s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-bbca1394-610b-4007-aa04-0039e6ebec63-8b955d8a-cbba-4fc1-a66a-9606481c529e" by "_create_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:15 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0186a992-5350-48f8-b664-42311e66844d tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Create snapshot completed successfully Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-bbca1394-610b-4007-aa04-0039e6ebec63-8b955d8a-cbba-4fc1-a66a-9606481c529e" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Creating volume 8b955d8a-cbba-4fc1-a66a-9606481c529e from snapshot bbca1394-610b-4007-aa04-0039e6ebec63 {{(pid=81522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-8b955d8a-cbba-4fc1-a66a-9606481c529e" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-8b955d8a-cbba-4fc1-a66a-9606481c529e" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] snapshot: bbca1394-610b-4007-aa04-0039e6ebec63, volume: 8b955d8a-cbba-4fc1-a66a-9606481c529e, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[82765a18-d1d8-42f1-8b8d-b2f63ced21db]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:16 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 Apr 24 19:17:16 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:16 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0" returned: 0 in 0.877s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:16 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0 Apr 24 19:17:16 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Acquiring lock "cinder-785685b6-97d6-455d-a7f8-ab79d06b3b1a-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-785685b6-97d6-455d-a7f8-ab79d06b3b1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Acquiring lock "cinder-quobyte-d8f86898-9a62-43c3-ae28-ff4e97984d2b" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-quobyte-d8f86898-9a62-43c3-ae28-ff4e97984d2b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Acquiring lock "cinder-quobyte-785685b6-97d6-455d-a7f8-ab79d06b3b1a" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:17 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-quobyte-785685b6-97d6-455d-a7f8-ab79d06b3b1a" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Deleting offline snapshot 785685b6-97d6-455d-a7f8-ab79d06b3b1a of volume d8f86898-9a62-43c3-ae28-ff4e97984d2b {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] snapshot_file for this snap is: volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63" returned: 0 in 1.226s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[435e4887-b2dd-49d7-8aa1-52149ed1d065]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830116e-283e-4b5f-85ab-32e37616ad66]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:17 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b Apr 24 19:17:17 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:17 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a Apr 24 19:17:17 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:17 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-acb1f4fb-d56a-4839-b88f-144c0f9907a0" returned: 0 in 1.022s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "cinder-quobyte-acb1f4fb-d56a-4839-b88f-144c0f9907a0" released by "delete_volume" :: held 1.964s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=113,cinder:INSERT=23,cinder:UPDATE=119,cinder:DELETE=11 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:DELETE=11,cinder:UPDATE=118,cinder:SELECT=89,cinder:INSERT=37 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Created reservations ['39697243-d248-424e-9c3b-bed8d16609f6', '32327182-4311-4fc1-a523-ad8e83dddb12', '07bcfdfd-483e-4f9f-8697-aec9f456ef2c', '324d6288-b39d-4c7c-9ad9-748fc0cf4a27'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:17 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:17 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:18 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a" returned: 0 in 0.936s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:17:18 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" returned: 0 in 0.982s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[294672ad-3324-4189-932a-f3bbabcad9e0]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:18 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e Apr 24 19:17:18 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:18 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b Apr 24 19:17:18 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:18 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.809s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:18 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Deleted volume successfully. Apr 24 19:17:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b98d47d4-a680-43ec-a188-1233828191a0 tempest-ServerRescueNegativeTestJSON-1370006284 None] Lock "cinder-acb1f4fb-d56a-4839-b88f-144c0f9907a0-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:19 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b" returned: 0 in 0.811s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:19 devstack sudo[86187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a Apr 24 19:17:19 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:17:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:21 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:21 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:22 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a" returned: 0 in 3.383s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:22 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a Apr 24 19:17:22 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Flow 'volume_create_manager' (94a5c33e-884a-425b-ad28-98584ca33c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb6b4cc-70a7-4600-ba80-070ac80f97e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb6b4cc-70a7-4600-ba80-070ac80f97e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1390294876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c293cc7-678e-49fe-8124-45e366304a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c73cb6b117e4c92975fb756892c0c32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:23Z,use_quota=True,user_id='085e68249f1243c795362ab5260cdbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000e9923-5266-418e-8390-4197778c059e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000e9923-5266-418e-8390-4197778c059e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79e5037-d2b6-44cb-97d7-552ff088c238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79e5037-d2b6-44cb-97d7-552ff088c238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c293cc7-678e-49fe-8124-45e366304a98', 'volume_name': 'volume-5c293cc7-678e-49fe-8124-45e366304a98', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93194403-f79f-48fd-bdee-c3ebdd810939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93194403-f79f-48fd-bdee-c3ebdd810939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab10b4b-303d-4983-93ff-134730cc915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:23 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Volume 5c293cc7-678e-49fe-8124-45e366304a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c293cc7-678e-49fe-8124-45e366304a98', 'volume_size': 1} Apr 24 19:17:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:24 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 2.887s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:24 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:25 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b.785685b6-97d6-455d-a7f8-ab79d06b3b1a" returned: 0 in 2.974s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:25 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-quobyte-785685b6-97d6-455d-a7f8-ab79d06b3b1a" released by "_delete_snapshot" :: held 8.414s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:25 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-quobyte-d8f86898-9a62-43c3-ae28-ff4e97984d2b" released by "delete_snapshot" :: held 8.505s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:25 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Created reservations ['f83eb543-8adf-4b4e-a2a8-508fd0c448ab', 'c2850c6c-8b98-4856-a599-e20c47249289', '252f3890-bb36-46ca-ad4c-2967536d1394', 'fff04f17-8d3c-41d5-8395-8e6d7a09b80b'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:25 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Delete snapshot completed successfully. Apr 24 19:17:25 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-be1c7c9a-a877-4088-9c08-3f2db0c8214b tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-785685b6-97d6-455d-a7f8-ab79d06b3b1a-delete_snapshot" released by "delete_snapshot" :: held 8.889s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Acquiring lock "cinder-d8f86898-9a62-43c3-ae28-ff4e97984d2b-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-d8f86898-9a62-43c3-ae28-ff4e97984d2b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Acquiring lock "cinder-quobyte-d8f86898-9a62-43c3-ae28-ff4e97984d2b" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-quobyte-d8f86898-9a62-43c3-ae28-ff4e97984d2b" acquired by "delete_volume" :: waited 0.048s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:26 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf60502-6777-47e4-9f0c-947cdacc76cd]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:26 devstack sudo[86250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b Apr 24 19:17:26 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:28 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e" returned: 0 in 10.114s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:28 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6a1f6-915a-4821-8cd6-6d838d293774]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:28 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b" returned: 0 in 1.710s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:28 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b Apr 24 19:17:28 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:28 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b Apr 24 19:17:28 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:28 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8f86898-9a62-43c3-ae28-ff4e97984d2b" returned: 0 in 0.509s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-quobyte-d8f86898-9a62-43c3-ae28-ff4e97984d2b" released by "delete_volume" :: held 2.436s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:28 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Created reservations ['d380d1f4-bfc1-456b-b5da-01b77a1ac5ae', 'c688dc5c-5064-47be-8404-35d5a9e7dff9', '2ba60b55-5282-4a87-bfec-d5a3f518ec08', '66c7b5f4-f481-4a8d-af23-a6b404be575c'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:29 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:29 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:29 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" returned: 0 in 0.788s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b, size 1024.00 MB, duration 10.12 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:17:29 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Converted 1024.00 MB image at 101.23 MB/s Apr 24 19:17:29 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:29 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e Apr 24 19:17:29 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:29 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.572s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Deleted volume successfully. Apr 24 19:17:29 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e" returned: 0 in 0.547s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f5115976-d271-426b-8f52-dfa8f0838eca tempest-VolumesSnapshotNegativeTestJSON-660390110 None] Lock "cinder-d8f86898-9a62-43c3-ae28-ff4e97984d2b-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-8b955d8a-cbba-4fc1-a66a-9606481c529e" released by "_copy_volume_from_snapshot" :: held 13.802s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-bbca1394-610b-4007-aa04-0039e6ebec63-8b955d8a-cbba-4fc1-a66a-9606481c529e" released by "_create_volume_from_snapshot" :: held 13.852s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.895s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.879s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1390294876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c293cc7-678e-49fe-8124-45e366304a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c73cb6b117e4c92975fb756892c0c32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:23Z,use_quota=True,user_id='085e68249f1243c795362ab5260cdbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Creating volume 5c293cc7-678e-49fe-8124-45e366304a98 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:29 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:29 devstack sudo[86284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98 1073741824 Apr 24 19:17:29 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c9500269-a83d-4f5f-b25b-7fff583cfa60 tempest-GroupSnapshotsTest-1745253942 None] Create group from source-snapshot-a512cddb-42f4-4b71-aa7c-3a098ace3023 completed successfully. Apr 24 19:17:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-8b955d8a-cbba-4fc1-a66a-9606481c529e" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-8b955d8a-cbba-4fc1-a66a-9606481c529e" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:30 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adf3140-7998-49e3-9bce-ab3eb3bfac03]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:30 devstack sudo[86301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e Apr 24 19:17:30 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:30 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98 1073741824" returned: 0 in 0.956s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:30 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98 Apr 24 19:17:30 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:31 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e" returned: 0 in 0.955s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:31 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e Apr 24 19:17:31 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:31 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98" returned: 0 in 0.850s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab10b4b-303d-4983-93ff-134730cc915b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c293cc7-678e-49fe-8124-45e366304a98', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db5d3de-03d3-4871-8487-d69b3267c108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:31 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Volume volume-5c293cc7-678e-49fe-8124-45e366304a98 (5c293cc7-678e-49fe-8124-45e366304a98): created successfully Apr 24 19:17:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db5d3de-03d3-4871-8487-d69b3267c108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Flow 'volume_create_manager' (94a5c33e-884a-425b-ad28-98584ca33c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:31 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-8670ae68-917d-4071-9ac4-0abb933cad9b tempest-VolumesMetadataTest-1587135894 None] Created volume successfully. Apr 24 19:17:32 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8b955d8a-cbba-4fc1-a66a-9606481c529e" returned: 0 in 0.614s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-8b955d8a-cbba-4fc1-a66a-9606481c529e" released by "delete_volume" :: held 1.668s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['caa51c82-8bb7-49e0-be42-e399e4c754d2'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:32 devstack cinder-volume[81522]: WARNING cinder.quota [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1153840906 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1153840906, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:32 devstack cinder-volume[81522]: WARNING cinder.quota [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1153840906 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1153840906, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['35199bdb-80c6-41a7-b06c-f1746230998e', 'd3c9e999-cb96-44fa-b760-64cbd2596c1f', '4642560f-910d-47d3-9b72-7a5a8e0d1457', 'f1c528b0-ef97-46d7-9da1-8c14d7f8e80c'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:32 devstack sudo[86331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:32 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:32 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] group_snapshot a512cddb-42f4-4b71-aa7c-3a098ace3023: deleting Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] group_snapshot a512cddb-42f4-4b71-aa7c-3a098ace3023: deleting {{(pid=81522) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Acquiring lock "cinder-5c293cc7-678e-49fe-8124-45e366304a98-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" acquired by "delete_snapshot" :: waited 0.054s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-bbca1394-610b-4007-aa04-0039e6ebec63" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Lock "cinder-5c293cc7-678e-49fe-8124-45e366304a98-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-bbca1394-610b-4007-aa04-0039e6ebec63" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Deleting offline snapshot bbca1394-610b-4007-aa04-0039e6ebec63 of volume 2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] snapshot_file for this snap is: volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[61461ea8-2ca0-47a8-8371-6eeb2ed4c10b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Acquiring lock "cinder-quobyte-5c293cc7-678e-49fe-8124-45e366304a98" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:33 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.693s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Lock "cinder-quobyte-5c293cc7-678e-49fe-8124-45e366304a98" acquired by "delete_volume" :: waited 0.059s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:33 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7896c6be-3b34-47e7-8174-1f8222973fdf tempest-GroupSnapshotsTest-1745253942 None] Delete group completed successfully. Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92a5d83-8828-403c-90cd-08c6c5ce0800]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:33 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 Apr 24 19:17:33 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:33 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98 Apr 24 19:17:33 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:33 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (e96f0704-674f-4192-b428-73f7c7248fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cf0942-1c83-427b-a05f-6e4525263024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63" returned: 0 in 0.885s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d2eede-9476-4c4f-80a6-f1fbb8a8698a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:34 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cf0942-1c83-427b-a05f-6e4525263024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-252558970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642c6f51-33e0-4dee-a0f6-dbae7fb62965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:34Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c50afe-d7f8-4f65-8b67-f3eed34b4f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c50afe-d7f8-4f65-8b67-f3eed34b4f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc04ccde-f638-43c7-8871-9e78a12c2690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc04ccde-f638-43c7-8871-9e78a12c2690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642c6f51-33e0-4dee-a0f6-dbae7fb62965', 'volume_name': 'volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34697603-2dc6-43b3-9a2c-acfb3539725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34697603-2dc6-43b3-9a2c-acfb3539725a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cf6fe5-cec6-4850-87af-0eb0fbc7a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:34 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume 642c6f51-33e0-4dee-a0f6-dbae7fb62965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965', 'volume_size': 1} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-252558970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642c6f51-33e0-4dee-a0f6-dbae7fb62965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:34Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Creating volume 642c6f51-33e0-4dee-a0f6-dbae7fb62965 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:34 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98" returned: 0 in 0.799s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:34 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 1073741824 Apr 24 19:17:34 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:34 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98 Apr 24 19:17:34 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:34 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b Apr 24 19:17:34 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:34 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5c293cc7-678e-49fe-8124-45e366304a98" returned: 0 in 0.517s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Lock "cinder-quobyte-5c293cc7-678e-49fe-8124-45e366304a98" released by "delete_volume" :: held 1.394s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Created reservations ['5b921722-866d-4552-bea9-95cda52c5a53', '8073daaf-ba21-4b09-a1e1-b232710701c1', '917cb1cb-c220-49e7-bb3c-a1d637a23c18', '36b57fe7-6233-434a-9f41-0aaf29c31285'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:34 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" returned: 0 in 0.700s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:34 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 Apr 24 19:17:34 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:34 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:34 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:34 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 1073741824" returned: 0 in 0.833s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:35 devstack sudo[86362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 Apr 24 19:17:35 devstack sudo[86362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:35 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.605s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:35 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Deleted volume successfully. Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c572b1a-1449-487e-968b-d75ec7bb7fe2 tempest-VolumesMetadataTest-1587135894 None] Lock "cinder-5c293cc7-678e-49fe-8124-45e366304a98-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:35 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63" returned: 0 in 0.854s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:35 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63 Apr 24 19:17:35 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:35 devstack sudo[86362]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965" returned: 0 in 0.678s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cf6fe5-cec6-4850-87af-0eb0fbc7a17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afc52ed-5568-4628-a18a-18e96f58ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:35 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 (642c6f51-33e0-4dee-a0f6-dbae7fb62965): created successfully Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afc52ed-5568-4628-a18a-18e96f58ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (e96f0704-674f-4192-b428-73f7c7248fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:35 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-902d1a33-69c6-4602-b9e2-e7eb5fb6952d tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created volume successfully. Apr 24 19:17:36 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b.bbca1394-610b-4007-aa04-0039e6ebec63" returned: 0 in 0.664s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-bbca1394-610b-4007-aa04-0039e6ebec63" released by "_delete_snapshot" :: held 3.230s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" released by "delete_snapshot" :: held 3.291s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:36 devstack cinder-volume[81522]: WARNING cinder.quota [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1153840906 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1153840906, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:36 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['3db31a12-edc3-4ca3-b7f2-5ba2efe64351', 'b7821a04-92ac-4b6a-81af-25532f84f53a', '533c39c0-aa5b-47b4-bd81-3d8f4b77b918', '12b3e395-d156-464b-8f66-08c411429811'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Creating offline snapshot dd7d187d-3e79-4005-b1b0-e52fb6968404 of volume 642c6f51-33e0-4dee-a0f6-dbae7fb62965 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:17:36 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8553923b-d41f-41e9-a2cb-8075a3672ead]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:36 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e1c44acb-7ba1-4bfd-8412-ee05e21688cf tempest-GroupSnapshotsTest-1745253942 None] group_snapshot a512cddb-42f4-4b71-aa7c-3a098ace3023: deleted successfully Apr 24 19:17:36 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 Apr 24 19:17:36 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:37 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965" returned: 0 in 0.729s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:37 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 1G Apr 24 19:17:37 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:37 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8d7017-cb15-4d7e-84e4-259b233da425]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:37 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b Apr 24 19:17:37 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:38 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 1G" returned: 0 in 0.802s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:38 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 Apr 24 19:17:38 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:38 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" returned: 0 in 0.855s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:38 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b Apr 24 19:17:38 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (330a5def-1db2-4cbd-bb17-91857bc75a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2c9260-bab1-418c-b07d-cf30b4fd51c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2c9260-bab1-418c-b07d-cf30b4fd51c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-128743706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb410f0d-723e-4e3e-b155-617a3a78c9f8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:38Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1e9fa7-6253-428a-8b8a-067aa0d731a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1e9fa7-6253-428a-8b8a-067aa0d731a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f90b306-7244-4730-9e56-a0ea5f2c2a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f90b306-7244-4730-9e56-a0ea5f2c2a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb410f0d-723e-4e3e-b155-617a3a78c9f8', 'volume_name': 'volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fc24f2-4301-4ad3-9adf-23f3ccb814f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fc24f2-4301-4ad3-9adf-23f3ccb814f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea07e24-2469-459e-96d3-e48cc90e002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:38 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Volume fb410f0d-723e-4e3e-b155-617a3a78c9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8', 'volume_size': 1} Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:38 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404" returned: 0 in 0.720s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:38 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 is being set with open permissions: ugo+rw Apr 24 19:17:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:38 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 Apr 24 19:17:38 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:39 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" returned: 0 in 0.559s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-2b7ecb48-98cf-4326-b9fa-1010e2efda6b" released by "delete_volume" :: held 1.486s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['da33bab1-0838-4e8b-8758-ff82820166c5'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:39 devstack cinder-volume[81522]: WARNING cinder.db.sqlalchemy.api [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1153840906'] Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['4356775b-cbcd-4a4e-baaa-d38a98253969', 'd0ad146a-3748-442f-97ac-56ca153c452e', 'd606caae-bfe1-4228-9d4e-8fd6dabcb735', '629ba8f9-3e18-47d5-9336-d5c7c4eff625'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:39 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404" returned: 0 in 0.552s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:39 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.info Apr 24 19:17:39 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:39 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:39 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:39 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.info" returned: 0 in 0.572s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:39 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.info is being set with open permissions: ugo+rw Apr 24 19:17:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:39 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.info Apr 24 19:17:39 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:40 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.664s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:40 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6800480f-2e6c-466d-98fc-a7ef15218263 tempest-GroupSnapshotsTest-1745253942 None] Delete group completed successfully. Apr 24 19:17:40 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2dade163-e87e-4bb5-9413-5174c07cc26b tempest-GroupSnapshotsTest-1745253942 None] Group tempest-GroupSnapshotsTest-Group-1986847790: creating Apr 24 19:17:40 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2dade163-e87e-4bb5-9413-5174c07cc26b tempest-GroupSnapshotsTest-1745253942 None] Group tempest-GroupSnapshotsTest-Group-1986847790: created successfully Apr 24 19:17:40 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2dade163-e87e-4bb5-9413-5174c07cc26b tempest-GroupSnapshotsTest-1745253942 None] Create group completed successfully. Apr 24 19:17:40 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.info" returned: 0 in 0.531s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.023s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.931s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-128743706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb410f0d-723e-4e3e-b155-617a3a78c9f8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:38Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Creating volume fb410f0d-723e-4e3e-b155-617a3a78c9f8 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:40 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:40 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 1073741824 Apr 24 19:17:40 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:40 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-077ed8f2-bd68-4404-aa42-7e5027c2f41c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Create snapshot completed successfully Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (a324f4c9-4da7-4860-8ccb-bd4f2fc234f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51896b6-9293-44cf-b54c-44fcebdcbdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51896b6-9293-44cf-b54c-44fcebdcbdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1838980844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c498a36-4b4a-4e0e-80f4-201d07f569e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:41Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ba044c-c816-4035-a7ff-9cebaf46e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ba044c-c816-4035-a7ff-9cebaf46e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0849f794-db78-42e9-b353-d0074394d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0849f794-db78-42e9-b353-d0074394d31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c498a36-4b4a-4e0e-80f4-201d07f569e9', 'volume_name': 'volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525f7840-e851-44fa-a049-782a547580ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525f7840-e851-44fa-a049-782a547580ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529573ea-bdba-4894-b90a-f00b7566593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume 2c498a36-4b4a-4e0e-80f4-201d07f569e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9', 'volume_size': 1} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (2f741db3-d6ea-4295-9488-e5ea1d5a40f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9019d19b-b80c-4bf1-a6b6-5d305870b430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9019d19b-b80c-4bf1-a6b6-5d305870b430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820801813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48efea96-e4cf-4c13-ad8e-c6e4c6990c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:41Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2450160f-d238-4377-b501-5c7a4ff1d460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2450160f-d238-4377-b501-5c7a4ff1d460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1725b834-1af5-41f0-bdf5-62d687e09767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1725b834-1af5-41f0-bdf5-62d687e09767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48efea96-e4cf-4c13-ad8e-c6e4c6990c4e', 'volume_name': 'volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d53929e-2f24-4cee-8ce6-bb6ac687cc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d53929e-2f24-4cee-8ce6-bb6ac687cc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31531a88-bca0-46f6-b35f-5631122a66e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:41 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume 48efea96-e4cf-4c13-ad8e-c6e4c6990c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e', 'volume_size': 1} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 1073741824" returned: 0 in 1.099s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:41 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 Apr 24 19:17:41 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (75e8906a-a6b6-4d60-b72a-8f7314c27cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f95804f-87ba-4609-aebe-c382bd1e5598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f95804f-87ba-4609-aebe-c382bd1e5598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283392774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ead5f8-5a52-46fe-a5f7-97b02196d146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:42Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a714266-7185-4881-8ed8-269815dea47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a714266-7185-4881-8ed8-269815dea47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c09fd98-f7fe-4a82-9eff-fef7b6881b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c09fd98-f7fe-4a82-9eff-fef7b6881b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ead5f8-5a52-46fe-a5f7-97b02196d146', 'volume_name': 'volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a89dcf-8625-4d83-91b5-e485689e987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a89dcf-8625-4d83-91b5-e485689e987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444c42ce-c748-4f7d-b8fe-f9bf5e1d1147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume d3ead5f8-5a52-46fe-a5f7-97b02196d146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146', 'volume_size': 1} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Flow 'volume_create_manager' (e7eb1342-4d57-4aa6-9e89-91f50492c2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ca9070-483a-47b2-8a26-a5197fe6f916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ca9070-483a-47b2-8a26-a5197fe6f916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632643889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e9cd886-1394-419b-a83c-2e3613bc765a,host='devstack@QuobyteHD#QuobyteHD',id=861d43c3-74ed-4bb5-b100-5b93c4d598f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0563fc8ce15f4c15a51f79b06eabe9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:42Z,use_quota=True,user_id='8c4550f176da4289915bc2f730b3a013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6800ad-d5b0-474e-a41d-52bbb54ac418),volume_type_id=db6800ad-d5b0-474e-a41d-52bbb54ac418)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0eb4d6-5eb4-4e13-ac13-ff2638d73341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0eb4d6-5eb4-4e13-ac13-ff2638d73341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfe5ccf-8aab-43ff-9478-4810221ef1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfe5ccf-8aab-43ff-9478-4810221ef1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861d43c3-74ed-4bb5-b100-5b93c4d598f5', 'volume_name': 'volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0989bf8f-b12f-4070-aee8-b6312db3751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0989bf8f-b12f-4070-aee8-b6312db3751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad513ae-3d8e-4a55-9aad-da56354a862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Volume 861d43c3-74ed-4bb5-b100-5b93c4d598f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5', 'volume_size': 1} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:42 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8" returned: 0 in 0.831s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1838980844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c498a36-4b4a-4e0e-80f4-201d07f569e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:41Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Creating volume 2c498a36-4b4a-4e0e-80f4-201d07f569e9 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:42 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea07e24-2469-459e-96d3-e48cc90e002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72121de6-2144-4d5b-bbf0-1ac4ddbba584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 1073741824 Apr 24 19:17:42 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:42 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Volume volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 (fb410f0d-723e-4e3e-b155-617a3a78c9f8): created successfully Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72121de6-2144-4d5b-bbf0-1ac4ddbba584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (330a5def-1db2-4cbd-bb17-91857bc75a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:42 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-bd3977f9-6ec3-4bed-931c-974eaa14770c tempest-VolumesGetTest-1085135426 None] Created volume successfully. Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (5d5d6572-af1d-4f05-9ae0-0f9492d7f80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689d3351-e604-4460-8dc4-33659455c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689d3351-e604-4460-8dc4-33659455c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2012319925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3c1ef8-8714-4150-95e6-57af960c0edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:42Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b00ebe-a341-4aaf-bc35-abb97c9c0c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b00ebe-a341-4aaf-bc35-abb97c9c0c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fab4b6-966f-47e3-9b18-d967d2aa2402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fab4b6-966f-47e3-9b18-d967d2aa2402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3c1ef8-8714-4150-95e6-57af960c0edd', 'volume_name': 'volume-4b3c1ef8-8714-4150-95e6-57af960c0edd', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62d1a3b-a0c0-46fc-960c-e64ef28ab562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62d1a3b-a0c0-46fc-960c-e64ef28ab562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8bf9e4-1ce6-425d-afa9-3fafc2504191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume 4b3c1ef8-8714-4150-95e6-57af960c0edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3c1ef8-8714-4150-95e6-57af960c0edd', 'volume_size': 1} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (80f2c052-6b30-491e-b728-eccbc5217b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400855e7-04f1-45f4-a4cd-6a6bc4fc8528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400855e7-04f1-45f4-a4cd-6a6bc4fc8528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-996111784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162f659a-3f5d-482d-9df9-7c99b80c5344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:43Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9cd129-8af8-4e84-87b9-0c4af0f3a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9cd129-8af8-4e84-87b9-0c4af0f3a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66797347-ca08-4ee1-bdd8-d7fc561d8d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66797347-ca08-4ee1-bdd8-d7fc561d8d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162f659a-3f5d-482d-9df9-7c99b80c5344', 'volume_name': 'volume-162f659a-3f5d-482d-9df9-7c99b80c5344', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172e2f77-55bc-498f-aa4d-728482fdbded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172e2f77-55bc-498f-aa4d-728482fdbded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f987c6-e0b1-4674-85cb-84c4c476af50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:42 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume 162f659a-3f5d-482d-9df9-7c99b80c5344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162f659a-3f5d-482d-9df9-7c99b80c5344', 'volume_size': 1} Apr 24 19:17:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:43 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 1073741824" returned: 0 in 1.027s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:43 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 Apr 24 19:17:43 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (d21cdbe0-826f-4abd-b034-0002336f8581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77412b3-10fe-41a5-abb7-2a45ece76778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77412b3-10fe-41a5-abb7-2a45ece76778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-844075052',display_name='tempest-VolumesGetTest-Volume-1232209361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6de1f0-e570-4e5b-9531-39072e00886d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:44Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13f03a8-a698-47bd-80d0-96c0c3d24de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13f03a8-a698-47bd-80d0-96c0c3d24de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fec418b-32d0-461e-9e94-e7aecc966e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fec418b-32d0-461e-9e94-e7aecc966e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6de1f0-e570-4e5b-9531-39072e00886d', 'volume_name': 'volume-1e6de1f0-e570-4e5b-9531-39072e00886d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f4a4a2-a3aa-4710-980b-a3f39e3197dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f4a4a2-a3aa-4710-980b-a3f39e3197dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bbf0e0-2197-42f0-954f-f02d83b7905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:44 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Volume 1e6de1f0-e570-4e5b-9531-39072e00886d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6de1f0-e570-4e5b-9531-39072e00886d', 'volume_size': 1} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:44 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9" returned: 0 in 0.698s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.685s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820801813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48efea96-e4cf-4c13-ad8e-c6e4c6990c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:41Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Creating volume 48efea96-e4cf-4c13-ad8e-c6e4c6990c4e {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:44 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529573ea-bdba-4894-b90a-f00b7566593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:44 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e 1073741824 Apr 24 19:17:44 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd9d720-6f34-423a-aa5e-e7011ece480a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:44 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 (2c498a36-4b4a-4e0e-80f4-201d07f569e9): created successfully Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd9d720-6f34-423a-aa5e-e7011ece480a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (a324f4c9-4da7-4860-8ccb-bd4f2fc234f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:44 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a4ac0914-10f7-4dc4-a983-33377d0562a0 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created volume successfully. Apr 24 19:17:45 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e 1073741824" returned: 0 in 0.705s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:45 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e Apr 24 19:17:45 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:45 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e" returned: 0 in 0.514s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.362s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283392774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ead5f8-5a52-46fe-a5f7-97b02196d146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:42Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Creating volume d3ead5f8-5a52-46fe-a5f7-97b02196d146 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:45 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:45 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 1073741824 Apr 24 19:17:45 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31531a88-bca0-46f6-b35f-5631122a66e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd5b897-0fe2-4449-a5e3-c04f59e37711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:45 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e (48efea96-e4cf-4c13-ad8e-c6e4c6990c4e): created successfully Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd5b897-0fe2-4449-a5e3-c04f59e37711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (2f741db3-d6ea-4295-9488-e5ea1d5a40f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:45 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c9fe3a10-d548-4527-89a8-e63a5533fd43 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created volume successfully. Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Flow 'volume_create_manager' (bad6b184-e83e-4407-8b1f-f2272ecf895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8772de71-c352-47ed-9954-192c467e8bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8772de71-c352-47ed-9954-192c467e8bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2082282382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df12cff-0b13-420f-8a15-9196ce205eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4d926a4047455ab9bb81f08ea9db65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:46Z,use_quota=True,user_id='7ef8fc51f6a243e5812e32d301c3e296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f6bfb4-fe85-49f1-bd55-1ad602a560a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f6bfb4-fe85-49f1-bd55-1ad602a560a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b90d79a-8140-404a-ade3-7e3038dc3dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b90d79a-8140-404a-ade3-7e3038dc3dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df12cff-0b13-420f-8a15-9196ce205eab', 'volume_name': 'volume-0df12cff-0b13-420f-8a15-9196ce205eab', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5ee799-d8f4-44d2-a99a-c48a1343e95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5ee799-d8f4-44d2-a99a-c48a1343e95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586b5935-1fd3-4cfa-8faa-83e9d3c9c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:46 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Volume 0df12cff-0b13-420f-8a15-9196ce205eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df12cff-0b13-420f-8a15-9196ce205eab', 'volume_size': 1} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:46 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 1073741824" returned: 0 in 0.775s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:46 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 Apr 24 19:17:46 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:46 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146" returned: 0 in 0.464s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.512s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e9cd886-1394-419b-a83c-2e3613bc765a,created_at=2026-04-24T17:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632643889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e9cd886-1394-419b-a83c-2e3613bc765a,host='devstack@QuobyteHD#QuobyteHD',id=861d43c3-74ed-4bb5-b100-5b93c4d598f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0563fc8ce15f4c15a51f79b06eabe9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:42Z,use_quota=True,user_id='8c4550f176da4289915bc2f730b3a013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6800ad-d5b0-474e-a41d-52bbb54ac418),volume_type_id=db6800ad-d5b0-474e-a41d-52bbb54ac418)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Creating volume 861d43c3-74ed-4bb5-b100-5b93c4d598f5 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:46 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:46 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 1073741824 Apr 24 19:17:46 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444c42ce-c748-4f7d-b8fe-f9bf5e1d1147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b9a8b7-d776-4595-9d03-d286c053e52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:46 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 (d3ead5f8-5a52-46fe-a5f7-97b02196d146): created successfully Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b9a8b7-d776-4595-9d03-d286c053e52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (75e8906a-a6b6-4d60-b72a-8f7314c27cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:46 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ec4407b8-f753-4493-9aef-aa369d307331 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created volume successfully. Apr 24 19:17:47 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 1073741824" returned: 0 in 0.771s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:47 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 Apr 24 19:17:47 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:48 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5" returned: 0 in 0.492s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.507s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2012319925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3c1ef8-8714-4150-95e6-57af960c0edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:42Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Creating volume 4b3c1ef8-8714-4150-95e6-57af960c0edd {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:48 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad513ae-3d8e-4a55-9aad-da56354a862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:48 devstack sudo[86458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd 1073741824 Apr 24 19:17:48 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11a5b79-dd1b-4860-b64d-f72a0f6767fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:48 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Volume volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 (861d43c3-74ed-4bb5-b100-5b93c4d598f5): created successfully Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11a5b79-dd1b-4860-b64d-f72a0f6767fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Flow 'volume_create_manager' (e7eb1342-4d57-4aa6-9e89-91f50492c2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:48 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-107a7688-6057-4d6a-89d3-966921b4b9fb tempest-GroupSnapshotsTest-1745253942 None] Created volume successfully. Apr 24 19:17:48 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd 1073741824" returned: 0 in 0.710s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:48 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd Apr 24 19:17:48 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Flow 'volume_create_manager' (93057ccc-0bba-40c1-a00e-8f8634267ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b198150d-eeab-43f4-957a-aab3e4916257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b198150d-eeab-43f4-957a-aab3e4916257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742674432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e9cd886-1394-419b-a83c-2e3613bc765a,host='devstack@QuobyteHD#QuobyteHD',id=1801ac24-8ddb-4520-b6c3-739b1cfe06f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0563fc8ce15f4c15a51f79b06eabe9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:49Z,use_quota=True,user_id='8c4550f176da4289915bc2f730b3a013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6800ad-d5b0-474e-a41d-52bbb54ac418),volume_type_id=db6800ad-d5b0-474e-a41d-52bbb54ac418)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba3d0c4-833a-4a23-879b-ab17314c71a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba3d0c4-833a-4a23-879b-ab17314c71a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c832f9db-b28f-4bcd-bc51-5816624fd0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c832f9db-b28f-4bcd-bc51-5816624fd0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1801ac24-8ddb-4520-b6c3-739b1cfe06f2', 'volume_name': 'volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02600c67-ca7c-44b7-99a4-c0be2b37c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02600c67-ca7c-44b7-99a4-c0be2b37c552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1cdab2-63f7-4ae0-828f-c36e9a0cf62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:49 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Volume 1801ac24-8ddb-4520-b6c3-739b1cfe06f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2', 'volume_size': 1} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:49 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd" returned: 0 in 0.576s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.620s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-996111784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162f659a-3f5d-482d-9df9-7c99b80c5344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a113e29f9c74d8ca675beba4b135938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:43Z,use_quota=True,user_id='932412986bdc431f9b863c5139517c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Creating volume 162f659a-3f5d-482d-9df9-7c99b80c5344 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:49 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:49 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344 1073741824 Apr 24 19:17:49 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8bf9e4-1ce6-425d-afa9-3fafc2504191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3c1ef8-8714-4150-95e6-57af960c0edd', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6382cfb-25a2-42c1-b6c1-0fa59b7265cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:49 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume volume-4b3c1ef8-8714-4150-95e6-57af960c0edd (4b3c1ef8-8714-4150-95e6-57af960c0edd): created successfully Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6382cfb-25a2-42c1-b6c1-0fa59b7265cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (5d5d6572-af1d-4f05-9ae0-0f9492d7f80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:49 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-803f869e-d66f-4971-abc6-305a959ad22c tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created volume successfully. Apr 24 19:17:50 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344 1073741824" returned: 0 in 0.621s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:50 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344 Apr 24 19:17:50 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:50 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344" returned: 0 in 0.504s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.533s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-844075052',display_name='tempest-VolumesGetTest-Volume-1232209361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6de1f0-e570-4e5b-9531-39072e00886d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:44Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Creating volume 1e6de1f0-e570-4e5b-9531-39072e00886d {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:50 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f987c6-e0b1-4674-85cb-84c4c476af50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162f659a-3f5d-482d-9df9-7c99b80c5344', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:50 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d 1073741824 Apr 24 19:17:50 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff8d89f-f110-49d5-b157-fbc313160fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:50 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Volume volume-162f659a-3f5d-482d-9df9-7c99b80c5344 (162f659a-3f5d-482d-9df9-7c99b80c5344): created successfully Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff8d89f-f110-49d5-b157-fbc313160fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Flow 'volume_create_manager' (80f2c052-6b30-491e-b728-eccbc5217b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:50 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-88163220-950a-4d1e-b2a4-39622269e9da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created volume successfully. Apr 24 19:17:51 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d 1073741824" returned: 0 in 0.722s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:51 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d Apr 24 19:17:51 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-162f659a-3f5d-482d-9df9-7c99b80c5344-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-162f659a-3f5d-482d-9df9-7c99b80c5344-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-quobyte-162f659a-3f5d-482d-9df9-7c99b80c5344" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-162f659a-3f5d-482d-9df9-7c99b80c5344" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a4cdf-88b6-4190-8116-108c372eb065]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:51 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d" returned: 0 in 0.506s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:51 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344 Apr 24 19:17:51 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.876s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2082282382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df12cff-0b13-420f-8a15-9196ce205eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4d926a4047455ab9bb81f08ea9db65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:46Z,use_quota=True,user_id='7ef8fc51f6a243e5812e32d301c3e296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Creating volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:51 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bbf0e0-2197-42f0-954f-f02d83b7905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6de1f0-e570-4e5b-9531-39072e00886d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826523d7-d2fa-4106-b138-d1302784891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:52 devstack sudo[86484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab 1073741824 Apr 24 19:17:52 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:52 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Volume volume-1e6de1f0-e570-4e5b-9531-39072e00886d (1e6de1f0-e570-4e5b-9531-39072e00886d): created successfully Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826523d7-d2fa-4106-b138-d1302784891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (d21cdbe0-826f-4abd-b034-0002336f8581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e3fd6a1c-9b21-45e0-bf59-1b396dcc322b tempest-VolumesGetTest-1085135426 None] Created volume successfully. Apr 24 19:17:52 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344" returned: 0 in 0.592s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:52 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344 Apr 24 19:17:52 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:52 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab 1073741824" returned: 0 in 0.716s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:52 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab Apr 24 19:17:52 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-1e6de1f0-e570-4e5b-9531-39072e00886d-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Lock "cinder-1e6de1f0-e570-4e5b-9531-39072e00886d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-quobyte-1e6de1f0-e570-4e5b-9531-39072e00886d" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-1e6de1f0-e570-4e5b-9531-39072e00886d" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a21fb03-a06b-4165-b44e-f30024984cd2]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:52 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d Apr 24 19:17:52 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:53 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-162f659a-3f5d-482d-9df9-7c99b80c5344" returned: 0 in 0.534s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-162f659a-3f5d-482d-9df9-7c99b80c5344" released by "delete_volume" :: held 1.169s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created reservations ['2f51e8b3-1f46-4903-b3e4-61d33aebe7e0', '4b6c6573-1a0e-4155-8bad-419d539cb5dd', 'ad498b23-48de-4394-9d98-2b1b3fb0ecc1', '3724b7b0-39d9-49e1-a21f-5034a2b00ed5'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:53 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:53 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:53 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab" returned: 0 in 0.520s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.970s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e9cd886-1394-419b-a83c-2e3613bc765a,created_at=2026-04-24T17:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742674432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e9cd886-1394-419b-a83c-2e3613bc765a,host='devstack@QuobyteHD#QuobyteHD',id=1801ac24-8ddb-4520-b6c3-739b1cfe06f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0563fc8ce15f4c15a51f79b06eabe9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:49Z,use_quota=True,user_id='8c4550f176da4289915bc2f730b3a013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6800ad-d5b0-474e-a41d-52bbb54ac418),volume_type_id=db6800ad-d5b0-474e-a41d-52bbb54ac418)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Creating volume 1801ac24-8ddb-4520-b6c3-739b1cfe06f2 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:53 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586b5935-1fd3-4cfa-8faa-83e9d3c9c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df12cff-0b13-420f-8a15-9196ce205eab', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:53 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 1073741824 Apr 24 19:17:53 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c2238d-6957-4f73-a20c-0bae6a6f06c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:53 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Volume volume-0df12cff-0b13-420f-8a15-9196ce205eab (0df12cff-0b13-420f-8a15-9196ce205eab): created successfully Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c2238d-6957-4f73-a20c-0bae6a6f06c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Flow 'volume_create_manager' (bad6b184-e83e-4407-8b1f-f2272ecf895e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:53 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0a26ec71-51b0-4b3a-91f7-b6ff8dc2f1d1 tempest-SnapshotsActionsTest-648580293 None] Created volume successfully. Apr 24 19:17:53 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d" returned: 0 in 0.608s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:53 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d Apr 24 19:17:53 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:53 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.577s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:53 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Deleted volume successfully. Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6e8074a1-49f9-4fce-a627-d929dd3ce58f tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-162f659a-3f5d-482d-9df9-7c99b80c5344-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-4b3c1ef8-8714-4150-95e6-57af960c0edd-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-4b3c1ef8-8714-4150-95e6-57af960c0edd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:54 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 1073741824" returned: 0 in 0.813s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-quobyte-4b3c1ef8-8714-4150-95e6-57af960c0edd" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-4b3c1ef8-8714-4150-95e6-57af960c0edd" acquired by "delete_volume" :: waited 0.040s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:54 devstack sudo[86513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 Apr 24 19:17:54 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8952b68d-f876-49db-9f2c-be7269a63ec6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:54 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd Apr 24 19:17:54 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:54 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1e6de1f0-e570-4e5b-9531-39072e00886d" returned: 0 in 0.758s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-1e6de1f0-e570-4e5b-9531-39072e00886d" released by "delete_volume" :: held 1.402s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Created reservations ['9bd1c802-c7ad-41e5-ad58-ace4b428e3de', 'eb054005-4fa8-4a0f-a3e5-751c022fe504', 'b1d8690d-54c0-4418-a6fe-a9ef69855a60', 'a510e44b-537f-4daa-86f5-fe1fe54e1c40'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:54 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:54 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:54 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" returned: 0 in 0.506s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.885s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Creating offline snapshot def73ae7-d608-4ad1-897a-48910cbf2dc0 of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1cdab2-63f7-4ae0-828f-c36e9a0cf62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d395c9-16d4-4bf6-a5e4-21e3e3fbf770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca151118-0433-4588-8bd4-c9d945c9a76f]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:54 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Volume volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 (1801ac24-8ddb-4520-b6c3-739b1cfe06f2): created successfully Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d395c9-16d4-4bf6-a5e4-21e3e3fbf770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Flow 'volume_create_manager' (93057ccc-0bba-40c1-a00e-8f8634267ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:54 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7e0853d5-9e31-41bd-8e03-a9c1c6e5c5ee tempest-GroupSnapshotsTest-1745253942 None] Created volume successfully. Apr 24 19:17:54 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd" returned: 0 in 0.617s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:54 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd Apr 24 19:17:54 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:54 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab Apr 24 19:17:54 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:54 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.503s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:54 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Deleted volume successfully. Apr 24 19:17:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b72f192-738f-4a79-a783-efeec3f4ccb9 tempest-VolumesGetTest-1085135426 None] Lock "cinder-1e6de1f0-e570-4e5b-9531-39072e00886d-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-fb410f0d-723e-4e3e-b155-617a3a78c9f8-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Lock "cinder-fb410f0d-723e-4e3e-b155-617a3a78c9f8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-quobyte-fb410f0d-723e-4e3e-b155-617a3a78c9f8" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-fb410f0d-723e-4e3e-b155-617a3a78c9f8" acquired by "delete_volume" :: waited 0.028s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d457f4-1461-4ba7-af30-f8aa842a69e4]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:55 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b3c1ef8-8714-4150-95e6-57af960c0edd" returned: 0 in 0.532s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-4b3c1ef8-8714-4150-95e6-57af960c0edd" released by "delete_volume" :: held 1.200s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:55 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab" returned: 0 in 0.660s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:55 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 Apr 24 19:17:55 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:55 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 1G Apr 24 19:17:55 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created reservations ['cbcb357a-0e5a-4399-bfe1-21391c3e6899', 'e600713b-0363-465a-93e4-b397a97d986f', '41a2711e-75e4-4018-8772-38a3a481df19', '27b1755d-254b-49df-9846-504d005af8c6'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:55 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:55 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:55 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8" returned: 0 in 0.616s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:55 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8 Apr 24 19:17:55 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:56 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ef17a9c4-a31c-4669-bc77-6911630d85ba tempest-GroupSnapshotsTest-1745253942 None] Update group completed successfully. Apr 24 19:17:56 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.621s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:56 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Deleted volume successfully. Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62ce83fc-6353-48f7-86ec-8123cdab7bdb tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-4b3c1ef8-8714-4150-95e6-57af960c0edd-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:56 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 1G" returned: 0 in 0.821s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:56 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:17:56 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-d3ead5f8-5a52-46fe-a5f7-97b02196d146-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-d3ead5f8-5a52-46fe-a5f7-97b02196d146-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-quobyte-d3ead5f8-5a52-46fe-a5f7-97b02196d146" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-d3ead5f8-5a52-46fe-a5f7-97b02196d146" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30548d4-cdb6-44f0-b7e0-f1c77892ba0c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:56 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fb410f0d-723e-4e3e-b155-617a3a78c9f8" returned: 0 in 0.596s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-fb410f0d-723e-4e3e-b155-617a3a78c9f8" released by "delete_volume" :: held 1.267s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Created reservations ['a8dd7104-b233-42ab-93cf-400c32ce9a27', 'dce6d9f2-2abf-40a2-836f-520eea263cd9', 'ebde5487-baff-4c52-b63e-fa1e02c464b3', '6b2a6d5d-91a6-4fc1-a317-bfc55ad8f4ac'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:56 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 Apr 24 19:17:56 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:56 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:56 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:56 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.612s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:56 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 is being set with open permissions: ugo+rw Apr 24 19:17:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:56 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:17:56 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:57 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146" returned: 0 in 0.608s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:57 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146 Apr 24 19:17:57 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:57 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.556s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:57 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Deleted volume successfully. Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-617c3809-151c-4b7c-a422-e9235327505b tempest-VolumesGetTest-1085135426 None] Lock "cinder-fb410f0d-723e-4e3e-b155-617a3a78c9f8-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:57 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-26cfb97a-f228-486d-ac5c-63760b056f15 tempest-GroupSnapshotsTest-1745253942 None] Update group completed successfully. Apr 24 19:17:57 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.540s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:57 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.info Apr 24 19:17:57 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:57 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d3ead5f8-5a52-46fe-a5f7-97b02196d146" returned: 0 in 0.574s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-d3ead5f8-5a52-46fe-a5f7-97b02196d146" released by "delete_volume" :: held 1.235s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created reservations ['482d0471-c8ba-41b8-a255-b9b4e09bc86c', '6cef8725-d51b-4303-8c4e-21a07d818610', '61ba4874-f125-4d33-b17a-6232314b2dc1', '9fb3a399-2559-4b2b-b093-cfbaedb28a8b'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (fae217cd-23a7-44bf-bfb6-626893b47172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d032ba6-50df-425c-b6b4-74171f264cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d032ba6-50df-425c-b6b4-74171f264cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1666770962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0664962-9ef0-41e1-881e-50bc6c1c99d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:58Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfac3da-1a99-4544-99d3-ed4053751423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfac3da-1a99-4544-99d3-ed4053751423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:57 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2245de82-b111-4f66-91dd-ef7ef12b5ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2245de82-b111-4f66-91dd-ef7ef12b5ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0664962-9ef0-41e1-881e-50bc6c1c99d7', 'volume_name': 'volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5a987e-6bf6-45c5-9841-0de29e52b338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5a987e-6bf6-45c5-9841-0de29e52b338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edcd5aa-b278-4e6f-a909-a87ce0db7a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:57 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Volume a0664962-9ef0-41e1-881e-50bc6c1c99d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7', 'volume_size': 1} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.info" returned: 0 in 0.554s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:57 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.info is being set with open permissions: ugo+rw Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:57 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.info Apr 24 19:17:57 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:58 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:17:58 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e095b872-f258-4bd8-86fe-c17e9591e770 tempest-GroupSnapshotsTest-1745253942 None] Update group completed successfully. Apr 24 19:17:58 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.info" returned: 0 in 0.554s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.865s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:58 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1666770962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0664962-9ef0-41e1-881e-50bc6c1c99d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:58Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Creating volume a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:58 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.568s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-43265153-128c-4d34-9d90-02e7625db2bb tempest-SnapshotsActionsTest-648580293 None] Create snapshot completed successfully Apr 24 19:17:58 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 1073741824 Apr 24 19:17:58 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Deleted volume successfully. Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-96ef4659-50a1-4662-aa9b-7a15636eca8e tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-d3ead5f8-5a52-46fe-a5f7-97b02196d146-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-quobyte-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dddc7a-7374-4346-9469-28adb55680fa]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:58 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e Apr 24 19:17:58 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:59 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 1073741824" returned: 0 in 0.772s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:59 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 Apr 24 19:17:59 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:59 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e" returned: 0 in 0.745s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:59 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e Apr 24 19:17:59 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c8be81ca-7a64-41ea-a277-0a699c7f021f tempest-GroupSnapshotsTest-1745253942 None] Update group completed successfully. Apr 24 19:17:59 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7" returned: 0 in 0.571s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.417s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Creating offline snapshot 74c796da-0a36-48c7-badb-d128258780cf of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edcd5aa-b278-4e6f-a909-a87ce0db7a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f09e5e2-2063-4a9e-a572-cf2fac3ae9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[551440a8-c31c-4bd4-a778-fb19ed573c07]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:00 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Volume volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 (a0664962-9ef0-41e1-881e-50bc6c1c99d7): created successfully Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f09e5e2-2063-4a9e-a572-cf2fac3ae9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (fae217cd-23a7-44bf-bfb6-626893b47172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:00 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-45fcab55-8f0b-44b8-8a9b-9d3f4f1dca38 tempest-VolumesGetTest-1085135426 None] Created volume successfully. Apr 24 19:18:00 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:00 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:00 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e" returned: 0 in 0.575s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e" released by "delete_volume" :: held 1.373s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created reservations ['dccdff46-4610-4c64-8982-a951790f359e', 'aad626b3-05fa-47a2-b5cb-4325dc1936a4', 'e933e1aa-ff10-42f1-9043-29c86dae01d3', '1e99dd2f-8d6b-4ba9-af29-1a2856d48422'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:00 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:00 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:00 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.640s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:00 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf 1G Apr 24 19:18:00 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:00 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.490s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:00 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Deleted volume successfully. Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c31109b-cb57-4255-b7f5-a9f239bc4ce1 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-48efea96-e4cf-4c13-ad8e-c6e4c6990c4e-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-2c498a36-4b4a-4e0e-80f4-201d07f569e9-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-2c498a36-4b4a-4e0e-80f4-201d07f569e9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-quobyte-2c498a36-4b4a-4e0e-80f4-201d07f569e9" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-2c498a36-4b4a-4e0e-80f4-201d07f569e9" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:01 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] GroupSnapshot 515ed754-c3bc-4e1c-a927-d5b9abb42379: creating. Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70d070e-b31c-49f5-9ce6-c119a43014f6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Group snapshot 515ed754-c3bc-4e1c-a927-d5b9abb42379: creating. {{(pid=81522) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:01 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 Apr 24 19:18:01 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:01 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf 1G" returned: 0 in 0.875s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:01 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf Apr 24 19:18:01 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (3587c8a5-c222-4164-9656-fd64519274f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07e62a8-8985-4d1b-bd48-8c711d5b417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07e62a8-8985-4d1b-bd48-8c711d5b417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1678964218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d5fd60-982f-4de7-95f9-4903b8dff217,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a0664962-9ef0-41e1-881e-50bc6c1c99d7,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:02Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b794bc1-8ca3-4919-8d7e-3ee6fa8bf819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b794bc1-8ca3-4919-8d7e-3ee6fa8bf819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ea3f23-b0e0-4094-950b-2552baedad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ea3f23-b0e0-4094-950b-2552baedad16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '29d5fd60-982f-4de7-95f9-4903b8dff217', 'volume_name': 'volume-29d5fd60-982f-4de7-95f9-4903b8dff217', 'volume_size': 1, 'source_volid': 'a0664962-9ef0-41e1-881e-50bc6c1c99d7', 'source_volstatus': 'available'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca55dbd6-73bc-453c-b721-8bdeb8c4c8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca55dbd6-73bc-453c-b721-8bdeb8c4c8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574967eb-7dab-4349-afea-4075b8176ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Volume 29d5fd60-982f-4de7-95f9-4903b8dff217: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-29d5fd60-982f-4de7-95f9-4903b8dff217', 'volume_size': 1, 'source_volid': 'a0664962-9ef0-41e1-881e-50bc6c1c99d7', 'source_volstatus': 'available'} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:01 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9" returned: 0 in 0.773s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:01 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9 Apr 24 19:18:01 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:02 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf" returned: 0 in 0.644s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:02 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf is being set with open permissions: ugo+rw Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:02 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf Apr 24 19:18:02 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:02 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2c498a36-4b4a-4e0e-80f4-201d07f569e9" returned: 0 in 0.464s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-2c498a36-4b4a-4e0e-80f4-201d07f569e9" released by "delete_volume" :: held 1.292s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created reservations ['9366eed7-18d6-4b35-9e28-97ede2223195', '92498030-7a87-4a53-83a6-100918670b8c', 'f21957e5-c2fa-43e3-b482-27208dbd5659', 'bee14b61-de85-4868-bf68-25dc891c48a2'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:02 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:02 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:02 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf" returned: 0 in 0.503s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.587s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Creating offline snapshot b00ec774-dcf2-4ed8-80f8-3cbd810ce6db of volume 861d43c3-74ed-4bb5-b100-5b93c4d598f5 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68225ca-2a86-4634-8902-a6aed8bb8a35]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:02 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0167ab18-0243-4a2e-b08b-bf8badc087d1 tempest-SnapshotsActionsTest-648580293 None] Create snapshot completed successfully Apr 24 19:18:02 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 Apr 24 19:18:02 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:02 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.505s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:02 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Deleted volume successfully. Apr 24 19:18:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6a8d481c-4baa-44af-8b30-6b7a162bf0da tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-2c498a36-4b4a-4e0e-80f4-201d07f569e9-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-dd7d187d-3e79-4005-b1b0-e52fb6968404-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-dd7d187d-3e79-4005-b1b0-e52fb6968404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-quobyte-642c6f51-33e0-4dee-a0f6-dbae7fb62965" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-642c6f51-33e0-4dee-a0f6-dbae7fb62965" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-quobyte-dd7d187d-3e79-4005-b1b0-e52fb6968404" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-dd7d187d-3e79-4005-b1b0-e52fb6968404" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Deleting offline snapshot dd7d187d-3e79-4005-b1b0-e52fb6968404 of volume 642c6f51-33e0-4dee-a0f6-dbae7fb62965 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] snapshot_file for this snap is: volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9b51b1-8349-41da-a3c5-ecaae5436d72]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:03 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5" returned: 0 in 0.654s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:03 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db 1G Apr 24 19:18:03 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:03 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 Apr 24 19:18:03 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-74c796da-0a36-48c7-badb-d128258780cf-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-74c796da-0a36-48c7-badb-d128258780cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-quobyte-74c796da-0a36-48c7-badb-d128258780cf" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-74c796da-0a36-48c7-badb-d128258780cf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Deleting offline snapshot 74c796da-0a36-48c7-badb-d128258780cf of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] snapshot_file for this snap is: volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f046a09e-a149-421d-9b9f-8f9827ee95bc]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:04 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf Apr 24 19:18:04 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:04 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404" returned: 0 in 0.651s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[debd9b3b-417c-4ba5-b42c-dc645111c899]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:04 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db 1G" returned: 0 in 0.685s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:04 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 Apr 24 19:18:04 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:04 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db Apr 24 19:18:04 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:04 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf" returned: 0 in 0.613s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e46be7-e924-433e-9af8-015aa7922f7e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:04 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db" returned: 0 in 0.521s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:04 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:04 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:04 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:04 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965" returned: 0 in 0.591s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:04 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db Apr 24 19:18:04 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:04 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 Apr 24 19:18:04 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:05 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db" returned: 0 in 0.476s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:05 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.607s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:05 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.info Apr 24 19:18:05 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:05 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf Apr 24 19:18:05 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:05 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404" returned: 0 in 0.636s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:05 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404 Apr 24 19:18:05 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:05 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.info" returned: 0 in 0.563s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:05 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:05 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.info Apr 24 19:18:05 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:05 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf" returned: 0 in 0.603s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:05 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf Apr 24 19:18:05 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:05 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965.dd7d187d-3e79-4005-b1b0-e52fb6968404" returned: 0 in 0.562s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-dd7d187d-3e79-4005-b1b0-e52fb6968404" released by "_delete_snapshot" :: held 2.604s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-642c6f51-33e0-4dee-a0f6-dbae7fb62965" released by "delete_snapshot" :: held 2.645s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created reservations ['bff9f231-de7e-4418-8bc8-1b9d32c3ff92', '5df7d1df-78e1-45f5-9d9b-98a2222664b3', 'd89a6869-69a9-40eb-abbc-0fcddb36553d', '023a7863-942e-4153-a6a2-6906beb7f1d5'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:06 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.info" returned: 0 in 0.529s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.553s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:06 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Creating offline snapshot d86d5a90-4b01-41ff-988b-94d78635820e of volume 1801ac24-8ddb-4520-b6c3-739b1cfe06f2 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:06 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Delete snapshot completed successfully. Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.74c796da-0a36-48c7-badb-d128258780cf" returned: 0 in 0.536s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2eab09-9c58-4fe1-8886-44bf9a1f4a4b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3e91605d-82a7-4ba8-90a5-c4eca33a68e9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-dd7d187d-3e79-4005-b1b0-e52fb6968404-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-74c796da-0a36-48c7-badb-d128258780cf" released by "_delete_snapshot" :: held 2.483s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" released by "delete_snapshot" :: held 2.511s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Created reservations ['a645d88d-c2a5-4b2d-86aa-5c7f642ee4c6', '6e59a372-a2af-4824-a0d1-32744d0bb299', 'fe062a3f-91dc-43ce-aec6-f4cde05123c7', '8410ea45-fb7e-418f-8390-f66108f26eea'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:06 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 Apr 24 19:18:06 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-642c6f51-33e0-4dee-a0f6-dbae7fb62965-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:06 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Delete snapshot completed successfully. Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8cdb72b-6adb-40d5-8494-dc342fb09863 tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-74c796da-0a36-48c7-badb-d128258780cf-delete_snapshot" released by "delete_snapshot" :: held 2.676s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-642c6f51-33e0-4dee-a0f6-dbae7fb62965-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "cinder-quobyte-642c6f51-33e0-4dee-a0f6-dbae7fb62965" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-642c6f51-33e0-4dee-a0f6-dbae7fb62965" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b4730a-df9d-4027-9811-0a5cf27f44d6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:06 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 Apr 24 19:18:06 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:06 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" returned: 0 in 0.647s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:07 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e 1G Apr 24 19:18:07 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:07 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965" returned: 0 in 0.632s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:07 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965 Apr 24 19:18:07 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:07 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e 1G" returned: 0 in 0.825s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:07 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e Apr 24 19:18:07 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:07 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-642c6f51-33e0-4dee-a0f6-dbae7fb62965" returned: 0 in 0.591s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-quobyte-642c6f51-33e0-4dee-a0f6-dbae7fb62965" released by "delete_volume" :: held 1.282s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Created reservations ['4c022f7a-1ed3-4f80-a6bc-b96a08334e64', '9c3f2433-055c-4228-a7b6-a10203d45e34', '90778ccc-a836-4278-a04e-221a4493c314', 'ceab3a24-c2ae-471f-9ec9-1d5c9637500f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:07 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:07 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:08 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e" returned: 0 in 0.502s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:08 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:18:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:08 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e Apr 24 19:18:08 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:08 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.497s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:08 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:08 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Deleted volume successfully. Apr 24 19:18:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-61e5b01a-f74b-4997-9aba-a4f4dc526dd9 tempest-CreateVolumesFromSnapshotTest-2135208218 None] Lock "cinder-642c6f51-33e0-4dee-a0f6-dbae7fb62965-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:08 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e" returned: 0 in 0.538s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:08 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.info Apr 24 19:18:08 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:09 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.info" returned: 0 in 0.572s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:09 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:18:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:09 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.info Apr 24 19:18:09 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:10 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.info" returned: 0 in 0.570s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.774s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.232s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:10 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Cloning volume a0664962-9ef0-41e1-881e-50bc6c1c99d7 to volume 29d5fd60-982f-4de7-95f9-4903b8dff217 Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Creating offline snapshot cac18fe4-9f26-40bb-b26f-f06406d426dd of volume a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[204d7515-c046-4dcc-9ff3-59747641391a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ff4996c7-28ce-4591-8229-2aaac97f7ae4 tempest-GroupSnapshotsTest-1745253942 None] group_snapshot 515ed754-c3bc-4e1c-a927-d5b9abb42379: created successfully Apr 24 19:18:10 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 Apr 24 19:18:10 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] group_snapshot 515ed754-c3bc-4e1c-a927-d5b9abb42379: deleting Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] group_snapshot 515ed754-c3bc-4e1c-a927-d5b9abb42379: deleting {{(pid=81522) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-861d43c3-74ed-4bb5-b100-5b93c4d598f5" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-861d43c3-74ed-4bb5-b100-5b93c4d598f5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-b00ec774-dcf2-4ed8-80f8-3cbd810ce6db" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-b00ec774-dcf2-4ed8-80f8-3cbd810ce6db" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Deleting offline snapshot b00ec774-dcf2-4ed8-80f8-3cbd810ce6db of volume 861d43c3-74ed-4bb5-b100-5b93c4d598f5 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] snapshot_file for this snap is: volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a4a2e-1c10-4c2f-9153-d7dce175739c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:10 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db Apr 24 19:18:10 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:10 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7" returned: 0 in 0.744s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:10 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd 1G Apr 24 19:18:10 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:11 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db" returned: 0 in 0.609s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de5012-cbf5-4891-bf31-537d37bfb657]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:11 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 Apr 24 19:18:11 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:11 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd 1G" returned: 0 in 0.811s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:11 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd Apr 24 19:18:11 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Flow 'volume_create_manager' (e940acc0-3469-44b9-8765-4fd1cf9f882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c663b6-4e44-4f09-82ae-d67c02ddd76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c663b6-4e44-4f09-82ae-d67c02ddd76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2056553227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43c2f17-030b-40d3-a71c-42b66e01ff39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dc54c5d0b9d4ed2939411a0dd6e8587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:12Z,use_quota=True,user_id='5061be38036a4c68b5196a982c056e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911b39f7-bd08-4da0-896b-47b8ab21c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911b39f7-bd08-4da0-896b-47b8ab21c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1659cef-de87-4a65-9bb8-614baba81f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1659cef-de87-4a65-9bb8-614baba81f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c43c2f17-030b-40d3-a71c-42b66e01ff39', 'volume_name': 'volume-c43c2f17-030b-40d3-a71c-42b66e01ff39', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd43b66-a8b4-47d9-acbd-8fae0476afa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd43b66-a8b4-47d9-acbd-8fae0476afa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1c6e4b-b947-473e-a1dc-2c726bb3e6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:12 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Volume c43c2f17-030b-40d3-a71c-42b66e01ff39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c43c2f17-030b-40d3-a71c-42b66e01ff39', 'volume_size': 1} Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:12 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5" returned: 0 in 0.679s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:12 devstack sudo[86782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db Apr 24 19:18:12 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:12 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd" returned: 0 in 0.599s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:12 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd is being set with open permissions: ugo+rw Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:12 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd Apr 24 19:18:12 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:12 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db" returned: 0 in 0.580s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:12 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db Apr 24 19:18:12 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:12 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd" returned: 0 in 0.471s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:12 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.info Apr 24 19:18:12 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:13 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5.b00ec774-dcf2-4ed8-80f8-3cbd810ce6db" returned: 0 in 0.473s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-b00ec774-dcf2-4ed8-80f8-3cbd810ce6db" released by "_delete_snapshot" :: held 2.465s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-861d43c3-74ed-4bb5-b100-5b93c4d598f5" released by "delete_snapshot" :: held 2.489s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-d86d5a90-4b01-41ff-988b-94d78635820e" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-d86d5a90-4b01-41ff-988b-94d78635820e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Deleting offline snapshot d86d5a90-4b01-41ff-988b-94d78635820e of volume 1801ac24-8ddb-4520-b6c3-739b1cfe06f2 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] snapshot_file for this snap is: volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d769ab8d-5296-4048-9d5c-5aa3994b10dd]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:13 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.info" returned: 0 in 0.504s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:13 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.info is being set with open permissions: ugo+rw Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:13 devstack sudo[86800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.info Apr 24 19:18:13 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:13 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e Apr 24 19:18:13 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:13 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.info" returned: 0 in 0.439s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-quobyte-29d5fd60-982f-4de7-95f9-4903b8dff217" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-29d5fd60-982f-4de7-95f9-4903b8dff217" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] snapshot: cac18fe4-9f26-40bb-b26f-f06406d426dd, volume: 29d5fd60-982f-4de7-95f9-4903b8dff217, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:18:13 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e" returned: 0 in 0.552s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f306a64-c3b4-4dfa-8381-1d475c23e2cf]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f62a6e-c995-4a77-b14e-9656977efcf5]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:13 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd Apr 24 19:18:13 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:13 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 Apr 24 19:18:13 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:14 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" returned: 0 in 0.571s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:14 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd" returned: 0 in 0.596s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:14 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:14 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:18:14 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:18:14 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e Apr 24 19:18:14 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:14 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3c5dd4-6edb-4ac3-acde-cbf8d21877a9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:14 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 Apr 24 19:18:14 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:15 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e" returned: 0 in 0.575s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:15 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e Apr 24 19:18:15 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:15 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7" returned: 0 in 0.575s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:15 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 Apr 24 19:18:15 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:15 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2.d86d5a90-4b01-41ff-988b-94d78635820e" returned: 0 in 0.471s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-d86d5a90-4b01-41ff-988b-94d78635820e" released by "_delete_snapshot" :: held 2.267s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" released by "delete_snapshot" :: held 2.299s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:15 devstack cinder-volume[81522]: WARNING cinder.quota [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1986959409 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1986959409, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:18:15 devstack cinder-volume[81522]: WARNING cinder.quota [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1986959409 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1986959409, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['6756e308-4e58-494a-b742-16e5993edaec', '7f3fd301-47e9-4950-8c3c-8011c4652c6a', 'ee45310d-84f5-40fa-a167-662dcb788395', '08228556-f1e8-41a9-836d-93484f0ce480'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:15 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['e4ca57ce-731b-48b3-94c3-128a7a975e10', '2fd1066d-540c-4f6e-accd-0322dc733386', 'c20c4f56-6a6d-4ea6-a21f-47a50fc585c5', '24fad43a-7ae9-4999-b426-7f7a2251e034'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:16 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e246223a-1ee5-49a4-a3b5-21249d03d602 tempest-GroupSnapshotsTest-1745253942 None] group_snapshot 515ed754-c3bc-4e1c-a927-d5b9abb42379: deleted successfully Apr 24 19:18:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" acquired by "delete_volume" :: waited 0.028s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:16 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a343704-f279-43b6-ad1e-472b73baea88]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:17 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 Apr 24 19:18:17 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:18 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" returned: 0 in 1.249s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:18 devstack sudo[86848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2 Apr 24 19:18:18 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:19 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" returned: 0 in 0.972s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-1801ac24-8ddb-4520-b6c3-739b1cfe06f2" released by "delete_volume" :: held 2.376s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-861d43c3-74ed-4bb5-b100-5b93c4d598f5" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-861d43c3-74ed-4bb5-b100-5b93c4d598f5" acquired by "delete_volume" :: waited 0.049s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[575abe41-3d9f-4750-a687-f719e99fd9d0]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:19 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 Apr 24 19:18:19 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:20 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5" returned: 0 in 1.230s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:20 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5 Apr 24 19:18:20 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:20 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217" returned: 0 in 5.562s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:20 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b3776f-ef09-430d-adc0-e379905479cb]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:20 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 Apr 24 19:18:20 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:21 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-861d43c3-74ed-4bb5-b100-5b93c4d598f5" returned: 0 in 0.482s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-861d43c3-74ed-4bb5-b100-5b93c4d598f5" released by "delete_volume" :: held 1.816s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=166,cinder:INSERT=52,cinder:UPDATE=209,cinder:DELETE=15 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:DELETE=12,cinder:SELECT=172,cinder:UPDATE=190,cinder:INSERT=45 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['2465ff10-f24c-4e02-bbc6-8e1f832105e7'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:21 devstack cinder-volume[81522]: WARNING cinder.quota [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1986959409 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1986959409, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['d329bb9f-98f9-4c2c-95b2-fbdce33c097a', 'e4cde179-2b0e-454c-8a85-683cd54b4b27', '363f5a07-50d2-4cc2-8ff9-2f02680f2bef', '80949b94-cc7f-429c-a306-2c70b4fb3759'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:21 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:21 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['a2de1d1e-3c94-4c71-9f0f-0d3aeaafa9df', 'bd253a85-f820-490e-8e64-bbf8cac834a9', '78138c1c-dae8-47ca-989d-c303725b5fe9', '7331840d-65be-473d-b226-2a73c8ff0c73'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:21 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7" returned: 0 in 0.733s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:18:21 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Converted 1024.00 MB image at 184.06 MB/s Apr 24 19:18:21 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 is being set with open permissions: ugo+rw Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:21 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 Apr 24 19:18:21 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:21 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:21 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:21 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.551s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:21 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217" returned: 0 in 0.515s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-29d5fd60-982f-4de7-95f9-4903b8dff217" released by "_copy_volume_from_snapshot" :: held 8.109s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-quobyte-cac18fe4-9f26-40bb-b26f-f06406d426dd" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-cac18fe4-9f26-40bb-b26f-f06406d426dd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Deleting offline snapshot cac18fe4-9f26-40bb-b26f-f06406d426dd of volume a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] snapshot_file for this snap is: volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a02c1a6-a32b-4f38-9a0c-cab0e852dc97]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:22 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.491s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:22 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-19c91482-4617-4a92-8b80-da258c92e0d2 tempest-GroupSnapshotsTest-1745253942 None] Delete group completed successfully. Apr 24 19:18:22 devstack sudo[86874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd Apr 24 19:18:22 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:22 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd" returned: 0 in 0.564s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:22 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:22 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97f1c21-3c6a-4c54-81f6-5bb5b2586dab]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:22 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 Apr 24 19:18:22 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:22 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-783b3a94-b034-446c-89f8-70609bd7a5a7 tempest-GroupSnapshotsTest-1745253942 None] Group tempest-GroupSnapshotsTest-Group-237615226: creating Apr 24 19:18:23 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-783b3a94-b034-446c-89f8-70609bd7a5a7 tempest-GroupSnapshotsTest-1745253942 None] Group tempest-GroupSnapshotsTest-Group-237615226: created successfully Apr 24 19:18:23 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-783b3a94-b034-446c-89f8-70609bd7a5a7 tempest-GroupSnapshotsTest-1745253942 None] Create group completed successfully. Apr 24 19:18:23 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7" returned: 0 in 0.567s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:23 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd Apr 24 19:18:23 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:23 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd" returned: 0 in 0.524s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:23 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd Apr 24 19:18:23 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:24 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7.cac18fe4-9f26-40bb-b26f-f06406d426dd" returned: 0 in 0.442s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-cac18fe4-9f26-40bb-b26f-f06406d426dd" released by "_delete_snapshot" :: held 2.194s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.134s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.759s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574967eb-7dab-4349-afea-4075b8176ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d5fd60-982f-4de7-95f9-4903b8dff217', 'volume_size': 1, 'source_volid': 'a0664962-9ef0-41e1-881e-50bc6c1c99d7', 'source_volstatus': 'available'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31a7ce7-f5f6-4d35-966a-ec1d5d0e8673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Creating offline snapshot 4667a424-b234-4451-b9c4-ef97e07fc6fb of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:24 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Volume volume-29d5fd60-982f-4de7-95f9-4903b8dff217 (29d5fd60-982f-4de7-95f9-4903b8dff217): created successfully Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31a7ce7-f5f6-4d35-966a-ec1d5d0e8673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (3587c8a5-c222-4164-9656-fd64519274f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf18d6e-34f5-4aea-9342-7703b6528a9c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:24 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-bc54e661-f32d-4d49-a142-81ee3b639d2a tempest-VolumesGetTest-1085135426 None] Created volume successfully. Apr 24 19:18:24 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:24 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Flow 'volume_create_manager' (a9378472-9a22-46a9-ac85-574e951774b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e7bbf5-6b39-4322-b419-630a774fd32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e7bbf5-6b39-4322-b419-630a774fd32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-810172074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2174f2a8-7541-4fcf-bbc4-a1ed90be8216,host='devstack@QuobyteHD#QuobyteHD',id=aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0563fc8ce15f4c15a51f79b06eabe9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:24Z,use_quota=True,user_id='8c4550f176da4289915bc2f730b3a013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f48e12f6-861e-4b98-9fd3-2ca165ac0697),volume_type_id=f48e12f6-861e-4b98-9fd3-2ca165ac0697)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5677ff-c7d2-473c-9be3-0a2d8052b2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5677ff-c7d2-473c-9be3-0a2d8052b2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de320c15-8ad0-4aa8-8057-053a72644f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de320c15-8ad0-4aa8-8057-053a72644f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59', 'volume_name': 'volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d79a8f9-582b-4d86-ad2e-44d09475da88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d79a8f9-582b-4d86-ad2e-44d09475da88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de85425b-f431-494a-90bc-8b218283109c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Volume aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59', 'volume_size': 1} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:24 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.638s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:24 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb 1G Apr 24 19:18:24 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (95b8ebf2-7634-4c49-8625-4ac48923f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a134b783-cea7-4513-9e3e-e094ad6c7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a134b783-cea7-4513-9e3e-e094ad6c7563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-993571848',display_name='tempest-VolumesGetTest-Volume-1916072438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31f8271-df85-4af9-a40f-d36ec88dc3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:25Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17be3646-b432-4311-96e5-720dc00949ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17be3646-b432-4311-96e5-720dc00949ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a636fcfa-afff-4df4-b415-6d769bf6083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a636fcfa-afff-4df4-b415-6d769bf6083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31f8271-df85-4af9-a40f-d36ec88dc3f2', 'volume_name': 'volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20363c85-e52f-4fe6-a6bd-213a28d1afcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20363c85-e52f-4fe6-a6bd-213a28d1afcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9225d0-ba87-48a9-853b-7f367a5d68e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:25 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Volume a31f8271-df85-4af9-a40f-d36ec88dc3f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2', 'volume_size': 1} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:25 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb 1G" returned: 0 in 0.693s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:25 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb Apr 24 19:18:25 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:26 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb" returned: 0 in 0.472s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:26 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb is being set with open permissions: ugo+rw Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:26 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb Apr 24 19:18:26 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:26 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb" returned: 0 in 0.450s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.391s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.590s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2056553227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43c2f17-030b-40d3-a71c-42b66e01ff39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dc54c5d0b9d4ed2939411a0dd6e8587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:12Z,use_quota=True,user_id='5061be38036a4c68b5196a982c056e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Creating volume c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:26 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:18:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:26 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 1073741824 Apr 24 19:18:26 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-8f89f2a8-1b6f-455e-9969-9eb37497a481 tempest-SnapshotsActionsTest-648580293 None] Create snapshot completed successfully Apr 24 19:18:26 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:27 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 1073741824" returned: 0 in 0.672s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:27 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 Apr 24 19:18:27 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-4667a424-b234-4451-b9c4-ef97e07fc6fb-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-4667a424-b234-4451-b9c4-ef97e07fc6fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-quobyte-4667a424-b234-4451-b9c4-ef97e07fc6fb" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-4667a424-b234-4451-b9c4-ef97e07fc6fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Deleting offline snapshot 4667a424-b234-4451-b9c4-ef97e07fc6fb of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] snapshot_file for this snap is: volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7bda48-749e-4608-8639-6f41e356bc0c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:27 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb Apr 24 19:18:27 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:27 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39" returned: 0 in 0.480s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.233s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2174f2a8-7541-4fcf-bbc4-a1ed90be8216,created_at=2026-04-24T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-810172074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2174f2a8-7541-4fcf-bbc4-a1ed90be8216,host='devstack@QuobyteHD#QuobyteHD',id=aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0563fc8ce15f4c15a51f79b06eabe9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:24Z,use_quota=True,user_id='8c4550f176da4289915bc2f730b3a013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f48e12f6-861e-4b98-9fd3-2ca165ac0697),volume_type_id=f48e12f6-861e-4b98-9fd3-2ca165ac0697)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Creating volume aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:27 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:27 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 1073741824 Apr 24 19:18:27 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1c6e4b-b947-473e-a1dc-2c726bb3e6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c43c2f17-030b-40d3-a71c-42b66e01ff39', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c01b617-8cf3-4eb9-873e-bdf5196eb647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:27 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Volume volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 (c43c2f17-030b-40d3-a71c-42b66e01ff39): created successfully Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c01b617-8cf3-4eb9-873e-bdf5196eb647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Flow 'volume_create_manager' (e940acc0-3469-44b9-8765-4fd1cf9f882b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:27 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-899524b7-0dfa-4841-af79-d0e94b1aabb0 tempest-VolumeDependencyTests-546412969 None] Created volume successfully. Apr 24 19:18:28 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb" returned: 0 in 0.550s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9337d9bf-33e8-4a5f-b359-173a70b4455b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:28 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:28 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:28 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 1073741824" returned: 0 in 0.785s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:28 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 Apr 24 19:18:28 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:28 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.643s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:28 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb Apr 24 19:18:28 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:29 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" returned: 0 in 0.474s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.804s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-993571848',display_name='tempest-VolumesGetTest-Volume-1916072438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31f8271-df85-4af9-a40f-d36ec88dc3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:25Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Creating volume a31f8271-df85-4af9-a40f-d36ec88dc3f2 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:29 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de85425b-f431-494a-90bc-8b218283109c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:29 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 1073741824 Apr 24 19:18:29 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b059171e-c0f4-4544-8d20-905f48704efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:29 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Volume volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 (aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59): created successfully Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b059171e-c0f4-4544-8d20-905f48704efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Flow 'volume_create_manager' (a9378472-9a22-46a9-ac85-574e951774b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-685bbc73-44ff-4ac7-bf83-0b5df01b0a35 tempest-GroupSnapshotsTest-1745253942 None] Created volume successfully. Apr 24 19:18:29 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb" returned: 0 in 0.631s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:29 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb Apr 24 19:18:29 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:29 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 1073741824" returned: 0 in 0.726s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:29 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.4667a424-b234-4451-b9c4-ef97e07fc6fb" returned: 0 in 0.550s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-4667a424-b234-4451-b9c4-ef97e07fc6fb" released by "_delete_snapshot" :: held 2.470s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" released by "delete_snapshot" :: held 2.502s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:29 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 Apr 24 19:18:29 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Created reservations ['ac55cde9-0902-4ced-8047-c062da39b8c0', '2b5686c3-7854-4f95-9660-b9bddf8b55bc', '09dc0bdc-44d8-48a3-8f65-fdc589a5219d', 'c323eb7c-7dc0-4688-b887-ff3128456d27'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:30 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Delete snapshot completed successfully. Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b23cc449-3a02-414f-9e0c-f1d193c9a69c tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-4667a424-b234-4451-b9c4-ef97e07fc6fb-delete_snapshot" released by "delete_snapshot" :: held 2.689s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:30 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] GroupSnapshot 1fd33f6d-5527-4128-a6a9-f55c2ec78314: creating. Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Group snapshot 1fd33f6d-5527-4128-a6a9-f55c2ec78314: creating. {{(pid=81522) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:30 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2" returned: 0 in 0.514s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.884s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9225d0-ba87-48a9-853b-7f367a5d68e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca46cdb-b211-4a78-bf02-8749782b9a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Creating offline snapshot a910cfba-7462-4422-9fed-3e31628d9e81 of volume c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:30 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Volume volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 (a31f8271-df85-4af9-a40f-d36ec88dc3f2): created successfully Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca46cdb-b211-4a78-bf02-8749782b9a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (95b8ebf2-7634-4c49-8625-4ac48923f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ecc663-7935-4157-a2f7-d7f4b7985fd3]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:30 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c09f5194-4fdd-4841-8591-f66e84e0908b tempest-VolumesGetTest-1085135426 None] Created volume successfully. Apr 24 19:18:30 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 Apr 24 19:18:30 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:31 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39" returned: 0 in 0.561s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:31 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 1G Apr 24 19:18:31 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:31 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 1G" returned: 0 in 0.671s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:31 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 Apr 24 19:18:31 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-a31f8271-df85-4af9-a40f-d36ec88dc3f2-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Lock "cinder-a31f8271-df85-4af9-a40f-d36ec88dc3f2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-quobyte-a31f8271-df85-4af9-a40f-d36ec88dc3f2" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-a31f8271-df85-4af9-a40f-d36ec88dc3f2" acquired by "delete_volume" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5395bef9-3591-45b8-aa6a-613092bfa67b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:31 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 Apr 24 19:18:31 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:32 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81" returned: 0 in 0.546s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:32 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 is being set with open permissions: ugo+rw Apr 24 19:18:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:32 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 Apr 24 19:18:32 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:32 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2" returned: 0 in 0.585s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:32 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2 Apr 24 19:18:32 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:32 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81" returned: 0 in 0.491s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:32 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.info Apr 24 19:18:32 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:32 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a31f8271-df85-4af9-a40f-d36ec88dc3f2" returned: 0 in 0.456s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-a31f8271-df85-4af9-a40f-d36ec88dc3f2" released by "delete_volume" :: held 1.087s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:32 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Created reservations ['f80fd040-5821-49bd-8ead-41735249fe01', '75bb08c8-6592-4a88-97e8-67ab4d4c089a', '55f66211-46e0-456c-954b-e897536a8eca', 'd035782f-60e4-4710-a28f-505a074587e5'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:33 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:33 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:33 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.info" returned: 0 in 0.494s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:33 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.info is being set with open permissions: ugo+rw Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:33 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.info Apr 24 19:18:33 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:33 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.475s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:33 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Deleted volume successfully. Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-57ca3cfd-734f-43bf-b983-f9fd16386dcd tempest-VolumesGetTest-1085135426 None] Lock "cinder-a31f8271-df85-4af9-a40f-d36ec88dc3f2-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:33 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.info" returned: 0 in 0.490s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.373s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.594s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Creating offline snapshot 60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 of volume aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:33 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-57101456-17ee-4ca4-b9f2-6e8ac8cd9133 tempest-VolumeDependencyTests-546412969 None] Create snapshot completed successfully Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1aeacf-0111-4e04-971e-90f55419b53f]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:33 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 Apr 24 19:18:33 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-29d5fd60-982f-4de7-95f9-4903b8dff217-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Lock "cinder-29d5fd60-982f-4de7-95f9-4903b8dff217-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-quobyte-29d5fd60-982f-4de7-95f9-4903b8dff217" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-29d5fd60-982f-4de7-95f9-4903b8dff217" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a0ab96-2c00-4c1b-9f35-0de172faa56e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:34 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 Apr 24 19:18:34 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:34 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" returned: 0 in 0.616s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:34 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 1G Apr 24 19:18:34 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:34 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217" returned: 0 in 0.589s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:34 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217 Apr 24 19:18:34 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:35 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 1G" returned: 0 in 0.737s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:35 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 Apr 24 19:18:35 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Flow 'volume_create_manager' (8d24c381-9cdf-49d6-a80b-129cc00b0b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d0d198-3346-495e-8381-a7a5bdffc6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:35 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-29d5fd60-982f-4de7-95f9-4903b8dff217" returned: 0 in 0.570s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d0d198-3346-495e-8381-a7a5bdffc6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1834430405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c524e5d7-48ac-44af-b134-ff0f91bdd11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dc54c5d0b9d4ed2939411a0dd6e8587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a910cfba-7462-4422-9fed-3e31628d9e81,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:35Z,use_quota=True,user_id='5061be38036a4c68b5196a982c056e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c0fb79-3b82-4935-95cb-93c09c0a3380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c0fb79-3b82-4935-95cb-93c09c0a3380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b390b56-3d68-4e57-9b1e-dc3ef208959a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b390b56-3d68-4e57-9b1e-dc3ef208959a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c524e5d7-48ac-44af-b134-ff0f91bdd11a', 'volume_name': 'volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a', 'volume_size': 1, 'snapshot_id': 'a910cfba-7462-4422-9fed-3e31628d9e81'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04dc7ba-b310-4859-8283-8c356bb99d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04dc7ba-b310-4859-8283-8c356bb99d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eca9dfe-3c08-4509-8224-e23215c2fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:35 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Volume c524e5d7-48ac-44af-b134-ff0f91bdd11a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a', 'volume_size': 1, 'snapshot_id': 'a910cfba-7462-4422-9fed-3e31628d9e81'} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-29d5fd60-982f-4de7-95f9-4903b8dff217" released by "delete_volume" :: held 1.250s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Created reservations ['767e84ea-0361-4f97-b4d6-255ce473a003', 'b2b4f01e-18c5-4337-81a0-a9cbdd5bc20b', '665f3d60-667f-4471-8743-409e6f36a0ad', '7d1ded05-fe62-433d-988e-ab1d85c3d81e'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:35 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:35 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:35 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9" returned: 0 in 0.541s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:35 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:35 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 Apr 24 19:18:35 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:35 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.450s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:35 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:36 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Deleted volume successfully. Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4823972c-b9db-49e5-9fb9-e6ce600dcefc tempest-VolumesGetTest-1085135426 None] Lock "cinder-29d5fd60-982f-4de7-95f9-4903b8dff217-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:36 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9" returned: 0 in 0.430s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:36 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.info Apr 24 19:18:36 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-a0664962-9ef0-41e1-881e-50bc6c1c99d7-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Lock "cinder-a0664962-9ef0-41e1-881e-50bc6c1c99d7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-quobyte-a0664962-9ef0-41e1-881e-50bc6c1c99d7" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-a0664962-9ef0-41e1-881e-50bc6c1c99d7" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d43b99-1d83-4590-b964-c20b79551cec]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:36 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 Apr 24 19:18:36 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:36 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.info" returned: 0 in 0.490s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:36 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:18:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:36 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.info Apr 24 19:18:36 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:37 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7" returned: 0 in 0.513s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:37 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7 Apr 24 19:18:37 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:37 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.info" returned: 0 in 0.478s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.382s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.342s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Creating offline snapshot a023072b-8cc4-43e5-8af1-186442ae9364 of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e233bce-5fe4-4c5d-9982-2a9c1d63e874]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:37 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-422e6f26-0778-4a5e-93a5-7cc4b5b3f7fa tempest-GroupSnapshotsTest-1745253942 None] group_snapshot 1fd33f6d-5527-4128-a6a9-f55c2ec78314: created successfully Apr 24 19:18:37 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:37 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:37 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a0664962-9ef0-41e1-881e-50bc6c1c99d7" returned: 0 in 0.490s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-a0664962-9ef0-41e1-881e-50bc6c1c99d7" released by "delete_volume" :: held 1.068s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Created reservations ['cb2b0f73-8f7d-43d7-9259-4fc83f6399fe', '05bd99a6-62f9-4580-876b-b2d1f05ee7b5', 'a53fb169-e321-4f9a-89f0-b9374ae4f18e', '7ad6dfb4-69e3-490d-9dba-6372cf4a092d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:37 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:37 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:37 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] group_snapshot 1fd33f6d-5527-4128-a6a9-f55c2ec78314: deleting Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] group_snapshot 1fd33f6d-5527-4128-a6a9-f55c2ec78314: deleting {{(pid=81522) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Deleting offline snapshot 60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 of volume aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] snapshot_file for this snap is: volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb5672-8310-452b-95b3-3e3518840c29]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:37 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.667s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:37 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 1G Apr 24 19:18:37 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:37 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 Apr 24 19:18:37 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:38 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.551s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:38 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:38 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Deleted volume successfully. Apr 24 19:18:38 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-822a882d-1a96-4191-a43a-b9c772c23d03 tempest-VolumesGetTest-1085135426 None] Lock "cinder-a0664962-9ef0-41e1-881e-50bc6c1c99d7-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:38 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9" returned: 0 in 0.630s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:38 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[38810da2-724f-49a9-bf5a-09a3142a5a23]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:38 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 Apr 24 19:18:38 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:38 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 1G" returned: 0 in 0.716s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:38 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 Apr 24 19:18:38 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (12ec7543-52a8-4aca-8f86-49c99fb5dbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4998c52-e79a-4ac4-9c2b-d4d65f5ce4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:39 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" returned: 0 in 0.695s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4998c52-e79a-4ac4-9c2b-d4d65f5ce4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2018904685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a049951-2e41-4fa7-8f85-801740b77eb7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:39Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02759cf2-e004-4249-b64d-1c18305a452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:39 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 Apr 24 19:18:39 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:39 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02759cf2-e004-4249-b64d-1c18305a452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb77b15-ba5a-47ef-819f-288e73ef37f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.image.glance [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Creating Keystone auth plugin from conf {{(pid=81522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364" returned: 0 in 0.628s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:39 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 is being set with open permissions: ugo+rw Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:39 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 Apr 24 19:18:39 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb77b15-ba5a-47ef-819f-288e73ef37f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a049951-2e41-4fa7-8f85-801740b77eb7', 'volume_name': 'volume-3a049951-2e41-4fa7-8f85-801740b77eb7', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16624d33-e857-48e6-ba73-90543bde7354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16624d33-e857-48e6-ba73-90543bde7354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3de9443-617e-4c08-b2bb-df54b908e2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:39 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Volume 3a049951-2e41-4fa7-8f85-801740b77eb7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a049951-2e41-4fa7-8f85-801740b77eb7', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Trying to clone 3a049951-2e41-4fa7-8f85-801740b77eb7 from image 25434dbf-f589-4779-867c-1dfa660304ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]). {{(pid=81522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:18:39 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364" returned: 0 in 0.573s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:39 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.705s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.500s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-a910cfba-7462-4422-9fed-3e31628d9e81-c524e5d7-48ac-44af-b134-ff0f91bdd11a" by "_create_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9" returned: 0 in 0.692s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:39 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e0699da1-740c-41c8-bac1-b4b72be3710e tempest-SnapshotsActionsTest-648580293 None] Create snapshot completed successfully Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-a910cfba-7462-4422-9fed-3e31628d9e81-c524e5d7-48ac-44af-b134-ff0f91bdd11a" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Creating volume c524e5d7-48ac-44af-b134-ff0f91bdd11a from snapshot a910cfba-7462-4422-9fed-3e31628d9e81 {{(pid=81522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:18:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:40 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9 Apr 24 19:18:40 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-c524e5d7-48ac-44af-b134-ff0f91bdd11a" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-c524e5d7-48ac-44af-b134-ff0f91bdd11a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] snapshot: a910cfba-7462-4422-9fed-3e31628d9e81, volume: c524e5d7-48ac-44af-b134-ff0f91bdd11a, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:18:40 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0c5d4-5100-4dd5-802c-9161d87d3bff]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafd7fc3-0f3a-4f6c-b173-60ff8d4c6d0a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 Apr 24 19:18:40 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD Apr 24 19:18:40 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-a023072b-8cc4-43e5-8af1-186442ae9364-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-a023072b-8cc4-43e5-8af1-186442ae9364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-quobyte-a023072b-8cc4-43e5-8af1-186442ae9364" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-a023072b-8cc4-43e5-8af1-186442ae9364" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Deleting offline snapshot a023072b-8cc4-43e5-8af1-186442ae9364 of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] snapshot_file for this snap is: volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa3a25b-bf7c-4d35-ad05-4fd3c1cc5122]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 Apr 24 19:18:40 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59.60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9" returned: 0 in 0.604s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-60c761b5-55f3-43b3-a3b9-ce0d0e8dfda9" released by "_delete_snapshot" :: held 2.738s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" released by "delete_snapshot" :: held 2.774s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:40 devstack cinder-volume[81522]: WARNING cinder.quota [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1472968591 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1472968591, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:18:40 devstack cinder-volume[81522]: WARNING cinder.quota [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1472968591 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1472968591, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['c26f828f-b6b8-4c84-b1c7-54f0de591fd9', 'd52be8a7-1dbd-41a6-84fb-2b5fdfcfec10', '81190d62-6066-419a-b159-80b27698be34', '5ad79875-3e0e-45da-89ec-cf99f919b4cd'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:40 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD" returned: 0 in 0.655s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Temporary image 25434dbf-f589-4779-867c-1dfa660304ca is fetched for user d528b3d657324060ab6e0d550dff2b11. {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:18:40 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2a1a4612-8802-4764-a20f-64ca38e09220 tempest-GroupSnapshotsTest-1745253942 None] group_snapshot 1fd33f6d-5527-4128-a6a9-f55c2ec78314: deleted successfully Apr 24 19:18:40 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81" returned: 0 in 0.694s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c43c2f17-030b-40d3-a71c-42b66e01ff39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[012e4af9-15db-4e35-8e49-96a4efe82941]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b29cb5c-2732-469d-9275-7b7e0e242123]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 Apr 24 19:18:40 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD Apr 24 19:18:40 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:41 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364" returned: 0 in 0.662s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ddeb32-ece1-4459-a3d6-f2cf696e6fc9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:41 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:41 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "cinder-quobyte-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:41 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39" returned: 0 in 0.618s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:41 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:41 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a Apr 24 19:18:41 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD" returned: 0 in 0.613s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" acquired by "delete_volume" :: waited 0.044s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad958d17-bd8d-4781-a188-5c2109e06f9f]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:41 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 Apr 24 19:18:41 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:41 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.670s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:41 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 Apr 24 19:18:41 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:42 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" returned: 0 in 0.664s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:42 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59 Apr 24 19:18:42 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:43 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364" returned: 0 in 1.270s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:43 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364 Apr 24 19:18:43 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:43 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" returned: 0 in 1.288s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Lock "cinder-quobyte-aa1d9bf4-ef99-4f4b-9f50-f7eb5f926a59" released by "delete_volume" :: held 2.059s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:43 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['7546a0de-4dec-4716-a61a-84e818926f0a'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:43 devstack cinder-volume[81522]: WARNING cinder.quota [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1472968591 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1472968591, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:18:43 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Created reservations ['62814b60-c8e4-405b-9087-b0d2197f00e5', '0930436f-d125-4acc-a7a3-b0fcbe6d9cda', '15c31126-6943-497f-bf81-2c7ceddefd67', '7560afc9-7b8c-478d-9721-03c302f40846'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:44 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:44 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:44 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.a023072b-8cc4-43e5-8af1-186442ae9364" returned: 0 in 1.237s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-a023072b-8cc4-43e5-8af1-186442ae9364" released by "_delete_snapshot" :: held 3.971s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" released by "delete_snapshot" :: held 4.001s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Created reservations ['412b5c39-7a25-4f5a-a81c-b52740fcbdc2', '77d08bd2-18d7-4a82-977c-3cbd47679048', '311be153-c084-4b8d-8096-48f832b276f8', '93a84078-299e-4021-b3fb-e330431fea43'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:44 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Delete snapshot completed successfully. Apr 24 19:18:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ba962591-7ed7-4d16-98fe-f6e747a981ea tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-a023072b-8cc4-43e5-8af1-186442ae9364-delete_snapshot" released by "delete_snapshot" :: held 4.314s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:45 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.908s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:45 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:45 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c9826cea-da1b-4e18-9acc-122c9385fa0b tempest-GroupSnapshotsTest-1745253942 None] Delete group completed successfully. Apr 24 19:18:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:47 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a" returned: 0 in 5.990s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:47 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d34147-bdd3-4fdf-a031-834816bd6621]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:47 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 Apr 24 19:18:47 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:48 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39" returned: 0 in 0.916s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:18:48 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Converted 1024.00 MB image at 170.91 MB/s Apr 24 19:18:48 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a is being set with open permissions: ugo+rw Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:48 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a Apr 24 19:18:48 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:48 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a" returned: 0 in 0.570s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-c524e5d7-48ac-44af-b134-ff0f91bdd11a" released by "_copy_volume_from_snapshot" :: held 8.925s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-a910cfba-7462-4422-9fed-3e31628d9e81-c524e5d7-48ac-44af-b134-ff0f91bdd11a" released by "_create_volume_from_snapshot" :: held 8.966s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.021s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.487s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2018904685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a049951-2e41-4fa7-8f85-801740b77eb7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:39Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Creating volume 3a049951-2e41-4fa7-8f85-801740b77eb7 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:48 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:18:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:49 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 1073741824 Apr 24 19:18:49 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eca9dfe-3c08-4509-8224-e23215c2fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a', 'volume_size': 1, 'snapshot_id': 'a910cfba-7462-4422-9fed-3e31628d9e81'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a094d66-99ca-4bbf-8545-0d5144dc39fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:49 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Volume volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a (c524e5d7-48ac-44af-b134-ff0f91bdd11a): created successfully Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a094d66-99ca-4bbf-8545-0d5144dc39fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Flow 'volume_create_manager' (8d24c381-9cdf-49d6-a80b-129cc00b0b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:49 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ac73f490-c9e5-4a02-891c-f68ab8e116e6 tempest-VolumeDependencyTests-546412969 None] Created volume successfully. Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-a910cfba-7462-4422-9fed-3e31628d9e81-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-a910cfba-7462-4422-9fed-3e31628d9e81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-c43c2f17-030b-40d3-a71c-42b66e01ff39" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-c43c2f17-030b-40d3-a71c-42b66e01ff39" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-a910cfba-7462-4422-9fed-3e31628d9e81" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-a910cfba-7462-4422-9fed-3e31628d9e81" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Deleting offline snapshot a910cfba-7462-4422-9fed-3e31628d9e81 of volume c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] snapshot_file for this snap is: volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f86dca-c627-4325-8e5c-560811b1608c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:49 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 1073741824" returned: 0 in 0.864s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:49 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 Apr 24 19:18:49 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:49 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 Apr 24 19:18:49 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:50 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7" returned: 0 in 0.605s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:50 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.703s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Creating offline snapshot 69349b73-cd70-4bc4-8d99-eb1cede357c8 of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81" returned: 0 in 0.788s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c43c2f17-030b-40d3-a71c-42b66e01ff39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bae5704-e02c-48c7-8e9e-173017dae4a9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e190a4b2-236f-4382-a2ce-8f9aa0225960]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Attempting download of 25434dbf-f589-4779-867c-1dfa660304ca ((None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}])) to volume 3a049951-2e41-4fa7-8f85-801740b77eb7. {{(pid=81522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3cc73-23ab-4d1a-bd92-45002bbdc42d]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_qv8gkv9q {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:50 devstack sudo[87164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:50 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:50 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 Apr 24 19:18:50 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:50 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_qv8gkv9q Apr 24 19:18:50 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:51 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_qv8gkv9q" returned: 0 in 0.555s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_qv8gkv9q {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39" returned: 0 in 0.714s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_qv8gkv9q Apr 24 19:18:51 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:51 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:51 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.755s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:51 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 1G Apr 24 19:18:51 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:51 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_qv8gkv9q" returned: 1 in 0.672s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_qv8gkv9q' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfcf231-7041-4160-a535-2bc5280d0aba]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81" returned: 0 in 0.670s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD Apr 24 19:18:52 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81 Apr 24 19:18:52 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0b161693-95ba-4f0b-8853-410c73210e8c tempest-GroupsV314Test-905228682 None] Group tempest-GroupsV314Test-Group-575240826: creating Apr 24 19:18:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0b161693-95ba-4f0b-8853-410c73210e8c tempest-GroupsV314Test-905228682 None] Group tempest-GroupsV314Test-Group-575240826: created successfully Apr 24 19:18:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0b161693-95ba-4f0b-8853-410c73210e8c tempest-GroupsV314Test-905228682 None] Create group completed successfully. Apr 24 19:18:52 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 1G" returned: 0 in 0.803s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 Apr 24 19:18:52 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39.a910cfba-7462-4422-9fed-3e31628d9e81" returned: 0 in 0.487s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-a910cfba-7462-4422-9fed-3e31628d9e81" released by "_delete_snapshot" :: held 2.788s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:52 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-c43c2f17-030b-40d3-a71c-42b66e01ff39" released by "delete_snapshot" :: held 2.816s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD" returned: 0 in 0.629s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] 25434dbf-f589-4779-867c-1dfa660304ca was qcow2, converting to raw {{(pid=81522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 Apr 24 19:18:52 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Created reservations ['d8da6c96-555b-414f-a46c-d9cdbd94347d', '0c3bcb8c-a4f4-4539-a9d4-d0fc1c39c5a4', '1de5c2fe-498b-4271-b5a6-255af272aada', 'f036f34f-3345-4796-a082-2ed5735549cc'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Delete snapshot completed successfully. Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1707724-c20c-4a09-9ea1-804ad56211b3 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-a910cfba-7462-4422-9fed-3e31628d9e81-delete_snapshot" released by "delete_snapshot" :: held 2.985s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:52 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8" returned: 0 in 0.548s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 is being set with open permissions: ugo+rw Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 Apr 24 19:18:52 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-c43c2f17-030b-40d3-a71c-42b66e01ff39-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-c43c2f17-030b-40d3-a71c-42b66e01ff39-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-c43c2f17-030b-40d3-a71c-42b66e01ff39" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-c43c2f17-030b-40d3-a71c-42b66e01ff39" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47eabfc-fe1f-4d31-830d-312b7c77961b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:53 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 Apr 24 19:18:53 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:53 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8" returned: 0 in 0.510s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.759s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:53 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-01307224-7d1b-4bf1-8dd8-c64402a7a7fa tempest-SnapshotsActionsTest-648580293 None] Create snapshot completed successfully Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Flow 'volume_create_manager' (9b1c2515-5797-419a-8ac8-28eda100b7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01168584-41ca-4b99-a98f-d2343f9ddeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01168584-41ca-4b99-a98f-d2343f9ddeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-812863745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e4b80d4-a98b-429c-8605-1ef4332d385f,host='devstack@QuobyteHD#QuobyteHD',id=429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b73bbcd424246cabe008f6e6c2acf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:54Z,use_quota=True,user_id='af54cb74000f4259a469ac834f9af6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a80fb93c-1770-4e1a-a520-b1549c7a30b8),volume_type_id=a80fb93c-1770-4e1a-a520-b1549c7a30b8)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9247245f-7b83-47a8-98fc-1673a7dc099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9247245f-7b83-47a8-98fc-1673a7dc099e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c12b97-468d-4da5-a623-59851c76862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c12b97-468d-4da5-a623-59851c76862b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d', 'volume_name': 'volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649fdbd0-7834-49a0-a6d4-c2771429d6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649fdbd0-7834-49a0-a6d4-c2771429d6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8a25f8-2152-4a95-85c6-e4ebe6a8a0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Volume 429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d', 'volume_size': 1} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e4b80d4-a98b-429c-8605-1ef4332d385f,created_at=2026-04-24T17:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-812863745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e4b80d4-a98b-429c-8605-1ef4332d385f,host='devstack@QuobyteHD#QuobyteHD',id=429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b73bbcd424246cabe008f6e6c2acf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:54Z,use_quota=True,user_id='af54cb74000f4259a469ac834f9af6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a80fb93c-1770-4e1a-a520-b1549c7a30b8),volume_type_id=a80fb93c-1770-4e1a-a520-b1549c7a30b8)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Creating volume 429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:53 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:53 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d 1073741824 Apr 24 19:18:53 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:53 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39" returned: 0 in 0.760s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:53 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39 Apr 24 19:18:53 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7" returned: 0 in 1.645s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_0pl4unqhdevstack@QuobyteHD, size 112.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:18:54 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Converted 112.00 MB image at 67.99 MB/s Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-69349b73-cd70-4bc4-8d99-eb1cede357c8-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:54 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 1G Apr 24 19:18:54 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-69349b73-cd70-4bc4-8d99-eb1cede357c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Acquiring lock "cinder-quobyte-69349b73-cd70-4bc4-8d99-eb1cede357c8" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-69349b73-cd70-4bc4-8d99-eb1cede357c8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Deleting offline snapshot 69349b73-cd70-4bc4-8d99-eb1cede357c8 of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] snapshot_file for this snap is: volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d247a2d8-c174-43b5-9066-b6f13109fd06]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:54 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c43c2f17-030b-40d3-a71c-42b66e01ff39" returned: 0 in 0.578s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-c43c2f17-030b-40d3-a71c-42b66e01ff39" released by "delete_volume" :: held 1.416s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:54 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d 1073741824" returned: 0 in 0.759s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:54 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 Apr 24 19:18:54 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Created reservations ['7f4f5309-b2bf-4a62-8b51-b386baf6da52', '430420cd-c9b1-494a-9ad9-74791707046e', '9a407319-ce9b-4cc2-8c87-f6c99df5edf3', '732a91fb-4949-4ac2-b8c0-bd6e30aac93d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:54 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d Apr 24 19:18:54 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:54 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:18:54 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 1G" returned: 0 in 0.607s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4e4f9c-b105-4aa6-82b5-38ccea27979e]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:54 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 Apr 24 19:18:54 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8" returned: 0 in 0.614s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[06facfa7-ca4b-4ed3-ab79-d1ce3f19bb83]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" returned: 0 in 0.572s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8a25f8-2152-4a95-85c6-e4ebe6a8a0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2bf2f6-12b1-4812-942f-9fc03247833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:55 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Volume volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d (429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d): created successfully Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2bf2f6-12b1-4812-942f-9fc03247833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Flow 'volume_create_manager' (9b1c2515-5797-419a-8ac8-28eda100b7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:55 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-da7063b9-b838-4509-949c-b09073415c08 tempest-GroupsV314Test-905228682 None] Created volume successfully. Apr 24 19:18:55 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:55 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:55 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.533s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:55 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Deleted volume successfully. Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-09a95f3b-393e-497f-96a2-632393fec808 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-c43c2f17-030b-40d3-a71c-42b66e01ff39-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:55 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7" returned: 0 in 0.609s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:55 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 Apr 24 19:18:55 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Flow 'volume_create_manager' (740f6b29-75ed-4e5d-8c38-92b711eb0f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947a5907-42b6-4870-a8c2-e5ad695ddf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947a5907-42b6-4870-a8c2-e5ad695ddf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-966237707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ba99f6-e618-4e8c-b192-a95237432b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dc54c5d0b9d4ed2939411a0dd6e8587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:55Z,use_quota=True,user_id='5061be38036a4c68b5196a982c056e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1518f19-7cbd-43db-b05a-61ea0b3318d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1518f19-7cbd-43db-b05a-61ea0b3318d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d20ae40-17e8-4811-88ec-bb02de436ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d20ae40-17e8-4811-88ec-bb02de436ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ba99f6-e618-4e8c-b192-a95237432b31', 'volume_name': 'volume-75ba99f6-e618-4e8c-b192-a95237432b31', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c201af9a-7935-4f03-b4ed-b252d972fd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c201af9a-7935-4f03-b4ed-b252d972fd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7660545e-2c01-45d3-b416-4743e77b1987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:55 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Volume 75ba99f6-e618-4e8c-b192-a95237432b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ba99f6-e618-4e8c-b192-a95237432b31', 'volume_size': 1} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-966237707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ba99f6-e618-4e8c-b192-a95237432b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dc54c5d0b9d4ed2939411a0dd6e8587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:55Z,use_quota=True,user_id='5061be38036a4c68b5196a982c056e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Creating volume 75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:55 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 1073741824 Apr 24 19:18:55 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:55 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.669s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 Apr 24 19:18:55 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:56 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7" returned: 1 in 0.577s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Downloaded image 25434dbf-f589-4779-867c-1dfa660304ca ((None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}])) to volume 3a049951-2e41-4fa7-8f85-801740b77eb7 successfully. {{(pid=81522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Temporary image 25434dbf-f589-4779-867c-1dfa660304ca for user d528b3d657324060ab6e0d550dff2b11 is deleted. {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Marking volume 3a049951-2e41-4fa7-8f85-801740b77eb7 as bootable. {{(pid=81522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Copying metadata from image 25434dbf-f589-4779-867c-1dfa660304ca to 3a049951-2e41-4fa7-8f85-801740b77eb7. {{(pid=81522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Creating volume glance metadata for volume 3a049951-2e41-4fa7-8f85-801740b77eb7 backed by image 25434dbf-f589-4779-867c-1dfa660304ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3de9443-617e-4c08-b2bb-df54b908e2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a049951-2e41-4fa7-8f85-801740b77eb7', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d854815-3883-475d-b693-7680a1b0561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:56 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Volume volume-3a049951-2e41-4fa7-8f85-801740b77eb7 (3a049951-2e41-4fa7-8f85-801740b77eb7): created successfully Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d854815-3883-475d-b693-7680a1b0561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (12ec7543-52a8-4aca-8f86-49c99fb5dbd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:56 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5dcf6247-c2ba-4b13-b34d-103346bcaf56 tempest-VolumesGetTest-1085135426 None] Created volume successfully. Apr 24 19:18:56 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 1073741824" returned: 0 in 0.756s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:56 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8" returned: 0 in 0.726s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:56 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8 Apr 24 19:18:56 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:56 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 Apr 24 19:18:56 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:56 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.69349b73-cd70-4bc4-8d99-eb1cede357c8" returned: 0 in 0.595s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-69349b73-cd70-4bc4-8d99-eb1cede357c8" released by "_delete_snapshot" :: held 2.711s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" released by "delete_snapshot" :: held 2.749s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:57 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31" returned: 0 in 0.649s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.300s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:57 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Cloning volume 429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d to volume 5adf2995-63ad-4510-9d32-1bd2eec8da1d Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7660545e-2c01-45d3-b416-4743e77b1987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ba99f6-e618-4e8c-b192-a95237432b31', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a94e7ea-212e-4e5d-ba33-c61d0b85acbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:57 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Volume volume-75ba99f6-e618-4e8c-b192-a95237432b31 (75ba99f6-e618-4e8c-b192-a95237432b31): created successfully Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a94e7ea-212e-4e5d-ba33-c61d0b85acbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Flow 'volume_create_manager' (740f6b29-75ed-4e5d-8c38-92b711eb0f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:57 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9e1f1342-20ec-4fad-a264-fd1d3e9049e5 tempest-VolumeDependencyTests-546412969 None] Created volume successfully. Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Creating offline snapshot f75293dd-d5eb-42c9-9fae-6f01b8502a59 of volume 429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Created reservations ['aff480a9-029b-4630-b969-3c2d3fe866fb', '2c2346d1-59c5-4e1c-b179-b248bec82a4e', '91d18f39-7e85-4114-a0bd-bd6a1e64e650', 'd8200d1b-7cd7-4a6b-9751-1b8722165b1d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f7967-8c31-4dda-af2a-d4905d33f3e6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:57 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d Apr 24 19:18:57 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:57 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Delete snapshot completed successfully. Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a34636c3-02fc-4410-aaba-d6640b7a046d tempest-SnapshotsActionsTest-638252732 None] Lock "cinder-69349b73-cd70-4bc4-8d99-eb1cede357c8-delete_snapshot" released by "delete_snapshot" :: held 3.054s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (40a1ee78-6eda-4c73-9bb0-5173b8c68b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8170a77-ef1a-4b9c-911c-af3b7267bcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8170a77-ef1a-4b9c-911c-af3b7267bcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1636555272',display_name='tempest-VolumesGetTest-Volume-2138754861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f82ad85-313e-4f92-a992-327e5e8d51a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:57Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fafa40-e9c2-42dd-9f45-47ca591b3a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fafa40-e9c2-42dd-9f45-47ca591b3a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d9be37-e711-41ec-867b-ba645058eb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d9be37-e711-41ec-867b-ba645058eb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f82ad85-313e-4f92-a992-327e5e8d51a4', 'volume_name': 'volume-0f82ad85-313e-4f92-a992-327e5e8d51a4', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82a3a79-883f-4c72-b717-cfb2387add65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82a3a79-883f-4c72-b717-cfb2387add65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54adfdf2-570f-4448-be90-6252fd71ec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:57 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Volume 0f82ad85-313e-4f92-a992-327e5e8d51a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f82ad85-313e-4f92-a992-327e5e8d51a4', 'volume_size': 1} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "cinder-def73ae7-d608-4ad1-897a-48910cbf2dc0-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-def73ae7-d608-4ad1-897a-48910cbf2dc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "cinder-quobyte-def73ae7-d608-4ad1-897a-48910cbf2dc0" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:57 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-quobyte-def73ae7-d608-4ad1-897a-48910cbf2dc0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Deleting offline snapshot def73ae7-d608-4ad1-897a-48910cbf2dc0 of volume 0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] snapshot_file for this snap is: volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" returned: 0 in 0.707s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[533a23b1-418c-4a58-b60e-5449f44fe284]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:57 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 1G Apr 24 19:18:57 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:58 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:58 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Flow 'volume_create_manager' (7d04cc6f-c330-464f-89dd-e0278b455eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501891ec-0c8e-4b6b-ab4c-b42bbc428a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501891ec-0c8e-4b6b-ab4c-b42bbc428a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1467863551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74b1b7c-d07e-4817-9f09-10b848ca0420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dc54c5d0b9d4ed2939411a0dd6e8587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=75ba99f6-e618-4e8c-b192-a95237432b31,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:58Z,use_quota=True,user_id='5061be38036a4c68b5196a982c056e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646aa6f5-04a5-4b69-8183-f6bf7190312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646aa6f5-04a5-4b69-8183-f6bf7190312f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029eee0f-8bdb-45a6-8c3b-e70081eb2093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029eee0f-8bdb-45a6-8c3b-e70081eb2093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a74b1b7c-d07e-4817-9f09-10b848ca0420', 'volume_name': 'volume-a74b1b7c-d07e-4817-9f09-10b848ca0420', 'volume_size': 1, 'source_volid': '75ba99f6-e618-4e8c-b192-a95237432b31', 'source_volstatus': 'available'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81009a0-0be9-45ec-b47d-36a55b2272f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81009a0-0be9-45ec-b47d-36a55b2272f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc3b7cc-d06a-4fb1-9acf-2679d48b37a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:58 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Volume a74b1b7c-d07e-4817-9f09-10b848ca0420: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a74b1b7c-d07e-4817-9f09-10b848ca0420', 'volume_size': 1, 'source_volid': '75ba99f6-e618-4e8c-b192-a95237432b31', 'source_volstatus': 'available'} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:58 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.618s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df12cff-0b13-420f-8a15-9196ce205eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecd4641-c74a-4fbf-af4a-be85c8d8582e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:58 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 1G" returned: 0 in 0.718s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:58 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab Apr 24 19:18:58 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:58 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 Apr 24 19:18:58 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:59 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab" returned: 0 in 0.548s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:59 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59" returned: 0 in 0.513s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:59 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:18:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:59 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:59 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:59 devstack sudo[87303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 Apr 24 19:18:59 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:59 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59" returned: 0 in 0.568s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:59 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.644s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:59 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.info Apr 24 19:18:59 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:59 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0 Apr 24 19:18:59 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:00 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.info" returned: 0 in 0.582s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:00 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:00 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.info Apr 24 19:19:00 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:00 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab.def73ae7-d608-4ad1-897a-48910cbf2dc0" returned: 0 in 0.623s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-quobyte-def73ae7-d608-4ad1-897a-48910cbf2dc0" released by "_delete_snapshot" :: held 2.570s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" released by "delete_snapshot" :: held 2.597s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Created reservations ['1f9972ee-58c8-4e99-85ab-f85d078ee3c1', '5f11814e-43a4-49bb-8265-88d757d4b7ab', '3dd419de-c45c-4a12-935a-d6f59a40f53b', '8fea96de-b35a-4353-8a3c-436631298a79'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:00 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Delete snapshot completed successfully. Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1be071c9-7b0d-4264-825b-9d40b0ef2d4c tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-def73ae7-d608-4ad1-897a-48910cbf2dc0-delete_snapshot" released by "delete_snapshot" :: held 2.778s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:00 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.info" returned: 0 in 0.510s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Acquiring lock "cinder-quobyte-5adf2995-63ad-4510-9d32-1bd2eec8da1d" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Lock "cinder-quobyte-5adf2995-63ad-4510-9d32-1bd2eec8da1d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] snapshot: f75293dd-d5eb-42c9-9fae-6f01b8502a59, volume: 5adf2995-63ad-4510-9d32-1bd2eec8da1d, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc4f5b2-a564-431c-b306-004c1711fb93]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:01 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 Apr 24 19:19:01 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "cinder-0df12cff-0b13-420f-8a15-9196ce205eab-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-0df12cff-0b13-420f-8a15-9196ce205eab-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef77f470-a977-4f07-a944-c5e32c946889]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:01 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab Apr 24 19:19:01 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:01 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59" returned: 0 in 0.659s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9250f5-e4bf-4145-99d1-47b6d201fee9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:01 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d Apr 24 19:19:01 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:01 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab" returned: 0 in 0.602s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:01 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab Apr 24 19:19:01 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:02 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" returned: 0 in 0.574s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:02 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d Apr 24 19:19:02 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:02 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0df12cff-0b13-420f-8a15-9196ce205eab" returned: 0 in 0.564s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-quobyte-0df12cff-0b13-420f-8a15-9196ce205eab" released by "delete_volume" :: held 1.257s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Created reservations ['c8e999a1-80db-49d6-a868-0ab48df04ad6', '8f1b20db-d22e-471d-be1b-19e085c73140', 'a2229ea7-2e4e-4230-82ff-7476948a03f9', 'f5e46c9b-a7bb-4e6a-af6c-a9a228fa821f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:02 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:02 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:03 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.907s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:03 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:03 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Deleted volume successfully. Apr 24 19:19:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1421b814-2f33-4686-8942-00f8c74b09cd tempest-SnapshotsActionsTest-648580293 None] Lock "cinder-0df12cff-0b13-420f-8a15-9196ce205eab-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:08 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d" returned: 0 in 6.617s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:08 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c389a46-0e52-4a50-a285-9db40c3c357b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:08 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d Apr 24 19:19:08 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:09 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" returned: 0 in 0.799s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:09 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:19:09 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Converted 1024.00 MB image at 154.72 MB/s Apr 24 19:19:09 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:19:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:09 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d Apr 24 19:19:09 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:10 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d" returned: 0 in 0.483s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Lock "cinder-quobyte-5adf2995-63ad-4510-9d32-1bd2eec8da1d" released by "_copy_volume_from_snapshot" :: held 9.222s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Acquiring lock "cinder-quobyte-f75293dd-d5eb-42c9-9fae-6f01b8502a59" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Lock "cinder-quobyte-f75293dd-d5eb-42c9-9fae-6f01b8502a59" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Deleting offline snapshot f75293dd-d5eb-42c9-9fae-6f01b8502a59 of volume 429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] snapshot_file for this snap is: volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1cb20-c6b7-4320-8923-f50334cc2c67]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:10 devstack sudo[87397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 Apr 24 19:19:10 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:10 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59" returned: 0 in 0.635s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b60155-5a48-4347-8589-a2e3b9f88e3a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:10 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d Apr 24 19:19:10 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:11 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" returned: 0 in 0.630s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:11 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 Apr 24 19:19:11 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Flow 'volume_create_manager' (d2d78e7e-c52f-4b49-8d79-2719a9c542b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2ba4a6-13bd-46b0-afbf-68b30ce0dd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2ba4a6-13bd-46b0-afbf-68b30ce0dd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-239875193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b16bb1-5135-4747-bae7-f09583cb1e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c0b5da4be4e09bb1fc0da8231ad8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:11Z,use_quota=True,user_id='9f666d712cce4a5b9f79982adca67764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c645c7-1ea8-4496-8409-efe863481abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c645c7-1ea8-4496-8409-efe863481abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580a3c0c-a217-48e6-b4b5-c5007f00604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580a3c0c-a217-48e6-b4b5-c5007f00604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b16bb1-5135-4747-bae7-f09583cb1e16', 'volume_name': 'volume-b0b16bb1-5135-4747-bae7-f09583cb1e16', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fa214a-9fa9-466b-8022-e37176c03179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fa214a-9fa9-466b-8022-e37176c03179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a65fb5a-e090-475c-8549-841c901cea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:11 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Volume b0b16bb1-5135-4747-bae7-f09583cb1e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b16bb1-5135-4747-bae7-f09583cb1e16', 'volume_size': 1} Apr 24 19:19:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:12 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59" returned: 0 in 0.561s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:12 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59 Apr 24 19:19:12 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:12 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d.f75293dd-d5eb-42c9-9fae-6f01b8502a59" returned: 0 in 0.448s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Lock "cinder-quobyte-f75293dd-d5eb-42c9-9fae-6f01b8502a59" released by "_delete_snapshot" :: held 2.373s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.454s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.042s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1636555272',display_name='tempest-VolumesGetTest-Volume-2138754861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f82ad85-313e-4f92-a992-327e5e8d51a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835c7441e71245b9b86435830df09d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:57Z,use_quota=True,user_id='d528b3d657324060ab6e0d550dff2b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Creating volume 0f82ad85-313e-4f92-a992-327e5e8d51a4 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:12 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:12 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 1073741824 Apr 24 19:19:12 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:12 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d21c788a-63f6-4e04-ab75-3a8729a46a6c tempest-GroupsV314Test-905228682 None] Create group from source-group-6e4b80d4-a98b-429c-8605-1ef4332d385f completed successfully. Apr 24 19:19:13 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 1073741824" returned: 0 in 0.680s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:13 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 Apr 24 19:19:13 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Acquiring lock "cinder-quobyte-5adf2995-63ad-4510-9d32-1bd2eec8da1d" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Lock "cinder-quobyte-5adf2995-63ad-4510-9d32-1bd2eec8da1d" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[625469ae-c6e5-4773-ad89-0de3f7eb596b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:13 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d Apr 24 19:19:13 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:13 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4" returned: 0 in 0.490s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 15.526s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:13 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Cloning volume 75ba99f6-e618-4e8c-b192-a95237432b31 to volume a74b1b7c-d07e-4817-9f09-10b848ca0420 Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54adfdf2-570f-4448-be90-6252fd71ec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f82ad85-313e-4f92-a992-327e5e8d51a4', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e158044-fc25-4636-8559-0a89e51f4436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:13 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Volume volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 (0f82ad85-313e-4f92-a992-327e5e8d51a4): created successfully Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e158044-fc25-4636-8559-0a89e51f4436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Flow 'volume_create_manager' (40a1ee78-6eda-4c73-9bb0-5173b8c68b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Creating offline snapshot bdfbda70-1678-495b-81a3-19bc995d9970 of volume 75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:19:13 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-06e9d342-5756-4482-a4c0-c82df874cbbc tempest-VolumesGetTest-1085135426 None] Created volume successfully. Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1bd648-29b4-42e5-8382-65814a86ae35]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:13 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 Apr 24 19:19:13 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:14 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d" returned: 0 in 0.591s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:14 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d Apr 24 19:19:14 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-0f82ad85-313e-4f92-a992-327e5e8d51a4-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Lock "cinder-0f82ad85-313e-4f92-a992-327e5e8d51a4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-quobyte-0f82ad85-313e-4f92-a992-327e5e8d51a4" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-0f82ad85-313e-4f92-a992-327e5e8d51a4" acquired by "delete_volume" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96f3c9e-d894-4172-8696-2d7d7b963999]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:14 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 Apr 24 19:19:14 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:14 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31" returned: 0 in 0.632s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:14 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 1G Apr 24 19:19:14 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:14 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5adf2995-63ad-4510-9d32-1bd2eec8da1d" returned: 0 in 0.610s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Lock "cinder-quobyte-5adf2995-63ad-4510-9d32-1bd2eec8da1d" released by "delete_volume" :: held 1.245s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Created reservations ['475aa2d7-217b-4187-9245-19d4b3b07ecd'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:14 devstack cinder-volume[81522]: WARNING cinder.quota [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-570947677 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-570947677, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:19:14 devstack cinder-volume[81522]: WARNING cinder.quota [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-570947677 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-570947677, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Created reservations ['89cbeafd-56cb-4661-a68d-1957bb41bd57', '4b5adecd-7c7d-4184-85b9-9b1880a6f7b1', 'e579b2d0-5764-497a-aac8-2b79aff4a239', '7111f6f5-6360-4fe7-8f41-6127482852be'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:14 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4" returned: 0 in 0.601s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:14 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4 Apr 24 19:19:14 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:14 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:14 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:15 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 1G" returned: 0 in 0.666s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ba99f6-e618-4e8c-b192-a95237432b31 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:15 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ba99f6-e618-4e8c-b192-a95237432b31 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 Apr 24 19:19:15 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:15 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.466s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:15 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-77263a4d-89ac-4acc-bfb1-95c6b68ca5f6 tempest-GroupsV314Test-905228682 None] Delete group completed successfully. Apr 24 19:19:15 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-0f82ad85-313e-4f92-a992-327e5e8d51a4" returned: 0 in 0.521s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-0f82ad85-313e-4f92-a992-327e5e8d51a4" released by "delete_volume" :: held 1.164s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Created reservations ['383da338-5bb8-417e-b5e6-d2c3da1baaf0', '7b371d31-62a9-4630-b576-a0e6c06fefad', 'dbdffee1-7bae-4e08-a2d4-f7c6ff646f64', '65e19b2b-5d14-43c1-864f-a20bd88fc7bb'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:15 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:15 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:15 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ba99f6-e618-4e8c-b192-a95237432b31 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970" returned: 0 in 0.548s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:15 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 is being set with open permissions: ugo+rw Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:15 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 Apr 24 19:19:15 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Acquiring lock "cinder-quobyte-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Lock "cinder-quobyte-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2d87d0-464b-4475-8fd8-bec27592dfad]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:16 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d Apr 24 19:19:16 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:16 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.493s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:16 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Deleted volume successfully. Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-233eb52d-9bee-46b7-8c84-07a052ef1111 tempest-VolumesGetTest-1085135426 None] Lock "cinder-0f82ad85-313e-4f92-a992-327e5e8d51a4-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:16 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970" returned: 0 in 0.530s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:16 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.info Apr 24 19:19:16 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-3a049951-2e41-4fa7-8f85-801740b77eb7-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Lock "cinder-3a049951-2e41-4fa7-8f85-801740b77eb7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Acquiring lock "cinder-quobyte-3a049951-2e41-4fa7-8f85-801740b77eb7" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-3a049951-2e41-4fa7-8f85-801740b77eb7" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:16 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" returned: 0 in 0.670s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ae600a-71ff-4a50-a4a7-cc0cf1c3fc8e]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:16 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d Apr 24 19:19:16 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:16 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 Apr 24 19:19:16 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:16 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.info" returned: 0 in 0.544s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:16 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.info is being set with open permissions: ugo+rw Apr 24 19:19:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:16 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.info Apr 24 19:19:16 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:17 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" returned: 0 in 0.527s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Lock "cinder-quobyte-429d2da6-b01c-4b1f-b9df-f4cb0f3c7b1d" released by "delete_volume" :: held 1.268s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:17 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7" returned: 0 in 0.579s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Created reservations ['9037c12c-a787-41bf-9a03-770f2501d846'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:17 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.info" returned: 0 in 0.475s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:17 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 Apr 24 19:19:17 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-a74b1b7c-d07e-4817-9f09-10b848ca0420" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Created reservations ['b606d4da-c5bf-43fd-bc13-95de1589f2ac', 'dc27ece8-f5a4-4fd9-b324-18c981fc2b22', '61e8df06-d1b7-4bcb-8291-7b9dfb018c20', '229e843e-4b2c-4bb0-b3f1-74fecf263c86'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-a74b1b7c-d07e-4817-9f09-10b848ca0420" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] snapshot: bdfbda70-1678-495b-81a3-19bc995d9970, volume: a74b1b7c-d07e-4817-9f09-10b848ca0420, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaa4df7-2a30-49d6-8322-3e11097ee35c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:17 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 Apr 24 19:19:17 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:17 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:17 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:17 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7" returned: 1 in 0.593s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:17 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7 Apr 24 19:19:17 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:17 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970" returned: 0 in 0.591s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75ba99f6-e618-4e8c-b192-a95237432b31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:19:17 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.496s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:17 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8da2da-e9d9-4380-a1b1-94a7d630b881]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:18 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b4ff0c15-14ed-4e2d-a1f6-c0fe8bf01637 tempest-GroupsV314Test-905228682 None] Delete group completed successfully. Apr 24 19:19:18 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 Apr 24 19:19:18 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:18 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3a049951-2e41-4fa7-8f85-801740b77eb7" returned: 0 in 0.557s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Lock "cinder-quobyte-3a049951-2e41-4fa7-8f85-801740b77eb7" released by "delete_volume" :: held 1.817s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Created reservations ['73576b79-c7b1-4b4a-b257-77884d9b1531', '09d92453-a38e-475c-b8b6-ab196e532505', '57524dc1-2332-4e08-a3cc-9d5cf326fbef', 'ca69fc82-9ebd-43fd-be93-863b8a43881f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:18 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:18 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:18 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31" returned: 0 in 0.646s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:19:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:18 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 Apr 24 19:19:18 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:19 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.596s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:19 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:19 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Deleted volume successfully. Apr 24 19:19:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f570314e-1da0-447e-a5d2-e302c96a6c19 tempest-VolumesGetTest-1085135426 None] Lock "cinder-3a049951-2e41-4fa7-8f85-801740b77eb7-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:19:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:21 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:21 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:22 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.274s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:25 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420" returned: 0 in 7.036s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:25 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6192ccfc-4b41-41b0-9c44-61be28531033]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:25 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 Apr 24 19:19:25 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:26 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31" returned: 0 in 0.900s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:26 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31, size 1024.00 MB, duration 7.04 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:19:26 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Converted 1024.00 MB image at 145.47 MB/s Apr 24 19:19:26 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 is being set with open permissions: ugo+rw Apr 24 19:19:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:26 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 Apr 24 19:19:26 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:27 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420" returned: 0 in 0.639s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-a74b1b7c-d07e-4817-9f09-10b848ca0420" released by "_copy_volume_from_snapshot" :: held 9.935s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=167,cinder:INSERT=54,cinder:UPDATE=187,cinder:DELETE=13 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-bdfbda70-1678-495b-81a3-19bc995d9970" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-bdfbda70-1678-495b-81a3-19bc995d9970" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Deleting offline snapshot bdfbda70-1678-495b-81a3-19bc995d9970 of volume 75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] snapshot_file for this snap is: volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f752388-8788-409a-b818-d8d859948964]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:27 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 Apr 24 19:19:27 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=157,cinder:UPDATE=175,cinder:INSERT=49,cinder:DELETE=7 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:19:27 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f0ce9c44-5a65-4feb-afa2-8683f5982bbe tempest-GroupsV320Test-1620568834 None] Group tempest-GroupsV320Test-Group-132082575: creating Apr 24 19:19:27 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f0ce9c44-5a65-4feb-afa2-8683f5982bbe tempest-GroupsV320Test-1620568834 None] Group tempest-GroupsV320Test-Group-132082575: created successfully Apr 24 19:19:27 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f0ce9c44-5a65-4feb-afa2-8683f5982bbe tempest-GroupsV320Test-1620568834 None] Create group completed successfully. Apr 24 19:19:27 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970" returned: 0 in 0.605s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75ba99f6-e618-4e8c-b192-a95237432b31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb15ab-67a5-4c8d-b8fb-14c58d967640]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:28 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 Apr 24 19:19:28 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:28 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31" returned: 0 in 0.635s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:28 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 Apr 24 19:19:28 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Flow 'volume_create_manager' (d1e05e59-cc6d-4cdb-baf3-35ea2a762859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c607a201-7649-4186-915a-9b831c057bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c607a201-7649-4186-915a-9b831c057bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1444010295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc41895-ed82-4843-9a38-7370f3671c6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed943d6c6cf4e649bb53d9a991fcdad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:29Z,use_quota=True,user_id='a370115da2264822bd6110d0b2b2aca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedb90cb-b596-4f29-a42f-fdce995aec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedb90cb-b596-4f29-a42f-fdce995aec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a851dcf-ac18-4431-9056-9b4bef723199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a851dcf-ac18-4431-9056-9b4bef723199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc41895-ed82-4843-9a38-7370f3671c6b', 'volume_name': 'volume-afc41895-ed82-4843-9a38-7370f3671c6b', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9a5e63-9e3c-476a-bba9-f189344f4bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9a5e63-9e3c-476a-bba9-f189344f4bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fb3ab1-7393-489d-958f-8b4d710ca437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:28 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Volume afc41895-ed82-4843-9a38-7370f3671c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc41895-ed82-4843-9a38-7370f3671c6b', 'volume_size': 1} Apr 24 19:19:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] Created reservations ['e5f5fab3-fc62-4a49-825f-fc11a0c57885'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:29 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970" returned: 0 in 0.666s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:29 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:29 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:29 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970 Apr 24 19:19:29 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:29 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.498s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-3d6e5fb5-946d-4fc4-b24d-a4c46398be88 tempest-GroupsV320Test-1620568834 None] Delete group completed successfully. Apr 24 19:19:29 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31.bdfbda70-1678-495b-81a3-19bc995d9970" returned: 0 in 0.538s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-bdfbda70-1678-495b-81a3-19bc995d9970" released by "_delete_snapshot" :: held 2.556s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.131s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.338s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-239875193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b16bb1-5135-4747-bae7-f09583cb1e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c0b5da4be4e09bb1fc0da8231ad8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:11Z,use_quota=True,user_id='9f666d712cce4a5b9f79982adca67764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Creating volume b0b16bb1-5135-4747-bae7-f09583cb1e16 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:29 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc3b7cc-d06a-4fb1-9acf-2679d48b37a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74b1b7c-d07e-4817-9f09-10b848ca0420', 'volume_size': 1, 'source_volid': '75ba99f6-e618-4e8c-b192-a95237432b31', 'source_volstatus': 'available'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:29 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 1073741824 Apr 24 19:19:29 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab795a6-b00f-4125-b88a-bbfd91163f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:29 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Volume volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 (a74b1b7c-d07e-4817-9f09-10b848ca0420): created successfully Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab795a6-b00f-4125-b88a-bbfd91163f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Flow 'volume_create_manager' (7d04cc6f-c330-464f-89dd-e0278b455eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e813fe5e-c73c-4b6e-bd04-d6342519fead tempest-VolumeDependencyTests-546412969 None] Created volume successfully. Apr 24 19:19:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-75ba99f6-e618-4e8c-b192-a95237432b31-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-75ba99f6-e618-4e8c-b192-a95237432b31-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-75ba99f6-e618-4e8c-b192-a95237432b31" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-75ba99f6-e618-4e8c-b192-a95237432b31" acquired by "delete_volume" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:30 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 1073741824" returned: 0 in 0.789s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:30 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9db717c-b57a-49dd-81ad-584292781833]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:30 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 Apr 24 19:19:30 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:30 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 Apr 24 19:19:30 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:31 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16" returned: 0 in 0.590s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.546s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1444010295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc41895-ed82-4843-9a38-7370f3671c6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed943d6c6cf4e649bb53d9a991fcdad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:29Z,use_quota=True,user_id='a370115da2264822bd6110d0b2b2aca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Creating volume afc41895-ed82-4843-9a38-7370f3671c6b {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:31 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a65fb5a-e090-475c-8549-841c901cea7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b16bb1-5135-4747-bae7-f09583cb1e16', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908673c9-e808-4c83-959e-175b0f6b61e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:31 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b 1073741824 Apr 24 19:19:31 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:31 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:31 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Volume volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 (b0b16bb1-5135-4747-bae7-f09583cb1e16): created successfully Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908673c9-e808-4c83-959e-175b0f6b61e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Flow 'volume_create_manager' (d2d78e7e-c52f-4b49-8d79-2719a9c542b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31" returned: 0 in 0.697s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:31 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7e575ec7-4518-4c43-aa04-0c615a7a9532 tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Created volume successfully. Apr 24 19:19:31 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31 Apr 24 19:19:31 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:31 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-75ba99f6-e618-4e8c-b192-a95237432b31" returned: 0 in 0.576s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-75ba99f6-e618-4e8c-b192-a95237432b31" released by "delete_volume" :: held 1.336s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Created reservations ['79446cd1-6c82-41e5-83fd-6db4730c342c', '6b265297-f031-43a6-86eb-5d1f4fbb322e', '1999e714-24a4-4740-8224-558da217282c', '2269963e-5af9-4b94-b5ac-1c0a85542108'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:32 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b 1073741824" returned: 0 in 0.812s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:32 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:32 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:32 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b Apr 24 19:19:32 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:32 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.522s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:32 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Deleted volume successfully. Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cade4e03-7fbc-45a1-a7cb-a5dd45097b88 tempest-VolumeDependencyTests-546412969 None] Lock "cinder-75ba99f6-e618-4e8c-b192-a95237432b31-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:32 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b" returned: 0 in 0.630s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fb3ab1-7393-489d-958f-8b4d710ca437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc41895-ed82-4843-9a38-7370f3671c6b', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f03e68-acf7-4daf-851f-47bfcd020cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-a74b1b7c-d07e-4817-9f09-10b848ca0420-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Lock "cinder-a74b1b7c-d07e-4817-9f09-10b848ca0420-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:32 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Volume volume-afc41895-ed82-4843-9a38-7370f3671c6b (afc41895-ed82-4843-9a38-7370f3671c6b): created successfully Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f03e68-acf7-4daf-851f-47bfcd020cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Flow 'volume_create_manager' (d1e05e59-cc6d-4cdb-baf3-35ea2a762859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:32 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4da74fdb-e8bd-444b-8115-bc4fdce57b37 tempest-VolumesListTestJSON-664647825 None] Created volume successfully. Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-a74b1b7c-d07e-4817-9f09-10b848ca0420" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-a74b1b7c-d07e-4817-9f09-10b848ca0420" acquired by "delete_volume" :: waited 0.032s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[73849e52-6db8-48d7-baeb-a5d807ed4df8]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:33 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 Apr 24 19:19:33 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Acquiring lock "cinder-b0b16bb1-5135-4747-bae7-f09583cb1e16-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "cinder-b0b16bb1-5135-4747-bae7-f09583cb1e16-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Acquiring lock "cinder-quobyte-b0b16bb1-5135-4747-bae7-f09583cb1e16" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "cinder-quobyte-b0b16bb1-5135-4747-bae7-f09583cb1e16" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[72708911-55e4-4e52-bd2c-db424e8366fb]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Flow 'volume_create_manager' (3e2d15e8-95f7-4991-93cd-540504438441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6d96af-46d6-46e6-bbcf-d6577554c6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6d96af-46d6-46e6-bbcf-d6577554c6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-311618796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd895938-38f9-4624-96b5-17dbaaa527fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed943d6c6cf4e649bb53d9a991fcdad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:34Z,use_quota=True,user_id='a370115da2264822bd6110d0b2b2aca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5612988-4a2a-414d-9532-d44007c3c7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5612988-4a2a-414d-9532-d44007c3c7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511fbfe3-c2c6-44c7-9715-5fb457cc1dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511fbfe3-c2c6-44c7-9715-5fb457cc1dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd895938-38f9-4624-96b5-17dbaaa527fc', 'volume_name': 'volume-fd895938-38f9-4624-96b5-17dbaaa527fc', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088deb56-f6ca-41e8-bd19-685614e3a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:33 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088deb56-f6ca-41e8-bd19-685614e3a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9baffd5-5515-4f18-b3eb-cda343d154b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:33 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Volume fd895938-38f9-4624-96b5-17dbaaa527fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd895938-38f9-4624-96b5-17dbaaa527fc', 'volume_size': 1} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-311618796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd895938-38f9-4624-96b5-17dbaaa527fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed943d6c6cf4e649bb53d9a991fcdad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:34Z,use_quota=True,user_id='a370115da2264822bd6110d0b2b2aca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Creating volume fd895938-38f9-4624-96b5-17dbaaa527fc {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:33 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:33 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:33 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420" returned: 0 in 0.791s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:33 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc 1073741824 Apr 24 19:19:33 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:33 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420 Apr 24 19:19:33 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:34 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16" returned: 0 in 0.822s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:34 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16 Apr 24 19:19:34 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:34 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a74b1b7c-d07e-4817-9f09-10b848ca0420" returned: 0 in 0.724s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-a74b1b7c-d07e-4817-9f09-10b848ca0420" released by "delete_volume" :: held 1.569s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Created reservations ['d9ddf318-f8dc-4696-baf4-a46215aca279', '4b3de8b6-0243-487f-8ee6-53a81921e2a5', 'e446f88c-56d7-4af5-8de0-f120b0a25dd8', '4d40ba24-fdac-441c-a73e-1c597db32d7b'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:34 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc 1073741824" returned: 0 in 0.853s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:34 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc Apr 24 19:19:34 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:34 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:34 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:35 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b0b16bb1-5135-4747-bae7-f09583cb1e16" returned: 0 in 0.610s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "cinder-quobyte-b0b16bb1-5135-4747-bae7-f09583cb1e16" released by "delete_volume" :: held 1.491s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Created reservations ['d69cbb8a-3366-4c85-b42a-c1fb3c2f761f', '9c967648-b3b9-4af8-8e62-4cbb2085de17', 'f649073e-bf6f-4c90-b0fd-218b7a1396ba', 'd3e48c0b-4c81-471f-8584-35e991474d3a'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-c524e5d7-48ac-44af-b134-ff0f91bdd11a-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Lock "cinder-c524e5d7-48ac-44af-b134-ff0f91bdd11a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:35 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc" returned: 0 in 0.678s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:35 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:35 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:35 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9baffd5-5515-4f18-b3eb-cda343d154b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd895938-38f9-4624-96b5-17dbaaa527fc', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a297e36-26e9-4726-bfd0-40b6720877d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.677s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Acquiring lock "cinder-quobyte-c524e5d7-48ac-44af-b134-ff0f91bdd11a" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:35 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Deleted volume successfully. Apr 24 19:19:35 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Volume volume-fd895938-38f9-4624-96b5-17dbaaa527fc (fd895938-38f9-4624-96b5-17dbaaa527fc): created successfully Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a297e36-26e9-4726-bfd0-40b6720877d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Flow 'volume_create_manager' (3e2d15e8-95f7-4991-93cd-540504438441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-c524e5d7-48ac-44af-b134-ff0f91bdd11a" acquired by "delete_volume" :: waited 0.056s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-77b5c5ec-77c2-4569-9039-53cebea7f1fb tempest-VolumeDependencyTests-546412969 None] Lock "cinder-a74b1b7c-d07e-4817-9f09-10b848ca0420-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:35 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f9334e59-2e4f-4a84-8ccb-5bbc2db26277 tempest-VolumesListTestJSON-664647825 None] Created volume successfully. Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac86120c-ffd7-438f-a425-bafb5d13b917]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:35 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a Apr 24 19:19:35 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:36 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.613s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:36 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Deleted volume successfully. Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-1f7d781b-fb0c-49a6-a91f-c3ccae6b274e tempest-VolumeQuotasNegativeTestJSON-2084999057 None] Lock "cinder-b0b16bb1-5135-4747-bae7-f09583cb1e16-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:36 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a" returned: 0 in 0.908s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:36 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a Apr 24 19:19:36 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Flow 'volume_create_manager' (8c9a6ad9-298f-4f04-96f3-9aa2d23ae8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423846c2-5a8b-4e9d-b4da-acd3067a25b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423846c2-5a8b-4e9d-b4da-acd3067a25b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1807543694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f204b9-a2e9-48c7-862d-fde922ac5c37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed943d6c6cf4e649bb53d9a991fcdad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:37Z,use_quota=True,user_id='a370115da2264822bd6110d0b2b2aca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0618e2-8b16-43f6-84a5-59b8dfdaf235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0618e2-8b16-43f6-84a5-59b8dfdaf235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6ab0ef-c5c7-46ce-8063-1cc1691c8380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6ab0ef-c5c7-46ce-8063-1cc1691c8380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2f204b9-a2e9-48c7-862d-fde922ac5c37', 'volume_name': 'volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddf4a69-a065-4d46-bccf-8193ba017f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddf4a69-a065-4d46-bccf-8193ba017f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14228df4-cff5-4f1d-85ef-1df42539657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:36 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Volume c2f204b9-a2e9-48c7-862d-fde922ac5c37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37', 'volume_size': 1} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1807543694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f204b9-a2e9-48c7-862d-fde922ac5c37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed943d6c6cf4e649bb53d9a991fcdad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:37Z,use_quota=True,user_id='a370115da2264822bd6110d0b2b2aca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Creating volume c2f204b9-a2e9-48c7-862d-fde922ac5c37 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:36 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:36 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 1073741824 Apr 24 19:19:36 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:37 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c524e5d7-48ac-44af-b134-ff0f91bdd11a" returned: 0 in 0.664s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Lock "cinder-quobyte-c524e5d7-48ac-44af-b134-ff0f91bdd11a" released by "delete_volume" :: held 1.640s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Created reservations ['e8a8d50f-9405-4616-ba8c-51f26b3f8267', 'a77aa516-2fea-45de-a97f-61d1b81a87e0', '3a3764b7-e9b3-456c-9e02-7ca301d24c30', 'b87c48ff-9a40-45e3-8ad8-d3c02b8216a1'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:37 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:37 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:37 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 1073741824" returned: 0 in 0.979s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:37 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 Apr 24 19:19:37 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Flow 'volume_create_manager' (81ca87b5-c157-4e80-a48e-ad0fbbaffc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80a92e7-59d5-4898-af95-742a4b7b2f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80a92e7-59d5-4898-af95-742a4b7b2f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2117719303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8850ec3c-5505-4077-bc54-437898cdd2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6461ed3ef6a34aacb9be640b67220952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:38Z,use_quota=True,user_id='a67ba2a23b154474a4fe8927374fb0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f724ee-4603-4f03-905f-44f62b5608a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f724ee-4603-4f03-905f-44f62b5608a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144829df-c811-4b88-9985-5891fd70848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144829df-c811-4b88-9985-5891fd70848b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8850ec3c-5505-4077-bc54-437898cdd2b1', 'volume_name': 'volume-8850ec3c-5505-4077-bc54-437898cdd2b1', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:38 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b0bb77-96ff-498a-a881-32f463ee21b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b0bb77-96ff-498a-a881-32f463ee21b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36622658-c2f9-4526-8b48-e493ef2bc293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:38 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Volume 8850ec3c-5505-4077-bc54-437898cdd2b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8850ec3c-5505-4077-bc54-437898cdd2b1', 'volume_size': 1} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.666s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:38 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Deleted volume successfully. Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac2fe7c5-c74a-4664-8692-868b6e826abc tempest-VolumeDependencyTests-546412969 None] Lock "cinder-c524e5d7-48ac-44af-b134-ff0f91bdd11a-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:38 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37" returned: 0 in 0.790s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2117719303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8850ec3c-5505-4077-bc54-437898cdd2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6461ed3ef6a34aacb9be640b67220952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:38Z,use_quota=True,user_id='a67ba2a23b154474a4fe8927374fb0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Creating volume 8850ec3c-5505-4077-bc54-437898cdd2b1 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:38 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:38 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1 1073741824 Apr 24 19:19:38 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14228df4-cff5-4f1d-85ef-1df42539657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93aa45f-aa59-4ef2-8e58-899e521e898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:38 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Volume volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 (c2f204b9-a2e9-48c7-862d-fde922ac5c37): created successfully Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93aa45f-aa59-4ef2-8e58-899e521e898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Flow 'volume_create_manager' (8c9a6ad9-298f-4f04-96f3-9aa2d23ae8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:38 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d9ed80b6-2d74-4859-94c8-47ecf548fb3d tempest-VolumesListTestJSON-664647825 None] Created volume successfully. Apr 24 19:19:39 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1 1073741824" returned: 0 in 0.951s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:39 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1 Apr 24 19:19:39 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:40 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1" returned: 0 in 0.772s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36622658-c2f9-4526-8b48-e493ef2bc293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8850ec3c-5505-4077-bc54-437898cdd2b1', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4773ac5-36bc-4a94-958b-bccb191aef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:40 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Volume volume-8850ec3c-5505-4077-bc54-437898cdd2b1 (8850ec3c-5505-4077-bc54-437898cdd2b1): created successfully Apr 24 19:19:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4773ac5-36bc-4a94-958b-bccb191aef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Flow 'volume_create_manager' (81ca87b5-c157-4e80-a48e-ad0fbbaffc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:40 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-065d05ec-75ad-4e34-942f-7b9ff1751a3c tempest-VolumeQuotasAdminTestJSON-350967504 None] Created volume successfully. Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Acquiring lock "cinder-8850ec3c-5505-4077-bc54-437898cdd2b1-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "cinder-8850ec3c-5505-4077-bc54-437898cdd2b1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Acquiring lock "cinder-quobyte-8850ec3c-5505-4077-bc54-437898cdd2b1" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "cinder-quobyte-8850ec3c-5505-4077-bc54-437898cdd2b1" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b08c9f2-48a7-4923-a038-1223eb44b27c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:41 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1 Apr 24 19:19:41 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "cinder-c2f204b9-a2e9-48c7-862d-fde922ac5c37-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Lock "cinder-c2f204b9-a2e9-48c7-862d-fde922ac5c37-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "cinder-quobyte-c2f204b9-a2e9-48c7-862d-fde922ac5c37" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Lock "cinder-quobyte-c2f204b9-a2e9-48c7-862d-fde922ac5c37" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2231cf10-59d9-4ab5-bfad-e99dbdda5e2b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:41 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 Apr 24 19:19:41 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:42 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1" returned: 0 in 0.703s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:42 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1 Apr 24 19:19:42 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:42 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37" returned: 0 in 0.737s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:42 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37 Apr 24 19:19:42 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:42 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Flow 'volume_create_manager' (173481ce-5e3d-4324-a99b-7525490b22f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a75cfbd-b7b1-43ea-9018-4de1626ba28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8850ec3c-5505-4077-bc54-437898cdd2b1" returned: 0 in 0.555s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a75cfbd-b7b1-43ea-9018-4de1626ba28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-759105062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20a18838a9c1468b939f79a50af4fad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:43Z,use_quota=True,user_id='79a23b2c6d0f4a9191d23752745d31f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(022ffa76-3d83-42e3-af98-3ad3900f292b),volume_type_id=022ffa76-3d83-42e3-af98-3ad3900f292b)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c471f27-5d8e-456c-b922-58e82b1fca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c471f27-5d8e-456c-b922-58e82b1fca77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7b189d-9a7e-41e8-8a00-603c192d7dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7b189d-9a7e-41e8-8a00-603c192d7dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6', 'volume_name': 'volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a3ef0f-9e91-42e2-bc6f-3903cfd21cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a3ef0f-9e91-42e2-bc6f-3903cfd21cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d00abc4-ef16-448f-be19-0bc8ce9cfeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:42 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Volume e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6', 'volume_size': 1} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-759105062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20a18838a9c1468b939f79a50af4fad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:43Z,use_quota=True,user_id='79a23b2c6d0f4a9191d23752745d31f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(022ffa76-3d83-42e3-af98-3ad3900f292b),volume_type_id=022ffa76-3d83-42e3-af98-3ad3900f292b)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Creating volume e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:42 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "cinder-quobyte-8850ec3c-5505-4077-bc54-437898cdd2b1" released by "delete_volume" :: held 1.370s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:42 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 1073741824 Apr 24 19:19:42 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Created reservations ['d8dd28d9-4aef-4556-9dd9-c9708ab80b8a', 'a24ec312-f2be-4cee-aaa1-225cdfac09c5', 'bc57550f-3d99-4e59-b371-184b718d2361', '37e38d07-e7f7-4ba1-a6ba-a52d1f676818'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:42 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:42 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:42 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c2f204b9-a2e9-48c7-862d-fde922ac5c37" returned: 0 in 0.565s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Lock "cinder-quobyte-c2f204b9-a2e9-48c7-862d-fde922ac5c37" released by "delete_volume" :: held 1.351s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Created reservations ['0fee64e4-b8ad-47aa-b829-cac207295185', '210b55a6-d284-4865-8e90-b111c3172797', 'a042e459-9ab5-4765-9619-614f8c1e2f46', 'ccd20605-a8a7-4189-b35c-f85a9de58d48'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:43 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:43 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:43 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 1073741824" returned: 0 in 0.663s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:43 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 Apr 24 19:19:43 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:43 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.593s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Deleted volume successfully. Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d3b70d5-8be1-4112-975b-c3ba6d744a55 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "cinder-8850ec3c-5505-4077-bc54-437898cdd2b1-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:43 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.576s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Deleted volume successfully. Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-19a85f47-d24a-4076-be6e-b520b9393130 tempest-VolumesListTestJSON-664647825 None] Lock "cinder-c2f204b9-a2e9-48c7-862d-fde922ac5c37-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Acquiring lock "cinder-fd895938-38f9-4624-96b5-17dbaaa527fc-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Lock "cinder-fd895938-38f9-4624-96b5-17dbaaa527fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Acquiring lock "cinder-quobyte-fd895938-38f9-4624-96b5-17dbaaa527fc" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Lock "cinder-quobyte-fd895938-38f9-4624-96b5-17dbaaa527fc" acquired by "delete_volume" :: waited 0.036s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f9035-3d6e-4793-a236-3d20628bc719]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:43 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:43 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Flow 'volume_create_manager' (7868b39c-8884-43b3-9677-1e24d9adc560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f25f9ff-81f5-427e-967a-2666546bce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6" returned: 0 in 0.645s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f25f9ff-81f5-427e-967a-2666546bce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1801775536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b350ef66-294d-423a-aa2d-6c6bb083e8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6461ed3ef6a34aacb9be640b67220952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:44Z,use_quota=True,user_id='a67ba2a23b154474a4fe8927374fb0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba951fa-990e-4239-9437-8dc4fe4bfcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba951fa-990e-4239-9437-8dc4fe4bfcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475f4338-aa92-4677-ba86-1ebda12179c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475f4338-aa92-4677-ba86-1ebda12179c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b350ef66-294d-423a-aa2d-6c6bb083e8d9', 'volume_name': 'volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:44 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc Apr 24 19:19:44 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcdebfb-81a5-44c9-887e-92b597c3ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcdebfb-81a5-44c9-887e-92b597c3ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9884ac-023f-459d-a334-0e5e5176cf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:44 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Volume b350ef66-294d-423a-aa2d-6c6bb083e8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9', 'volume_size': 1} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1801775536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b350ef66-294d-423a-aa2d-6c6bb083e8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6461ed3ef6a34aacb9be640b67220952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:44Z,use_quota=True,user_id='a67ba2a23b154474a4fe8927374fb0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Creating volume b350ef66-294d-423a-aa2d-6c6bb083e8d9 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:44 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d00abc4-ef16-448f-be19-0bc8ce9cfeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:44 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 1073741824 Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9057136-2c4f-4477-a98d-602768594ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:44 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:44 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Volume volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 (e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6): created successfully Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9057136-2c4f-4477-a98d-602768594ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Flow 'volume_create_manager' (173481ce-5e3d-4324-a99b-7525490b22f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:44 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-39dc8dec-0196-41b2-b3d7-dd7ff6b82c21 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Created volume successfully. Apr 24 19:19:44 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc" returned: 0 in 0.518s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:44 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc Apr 24 19:19:44 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:44 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 1073741824" returned: 0 in 0.689s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:44 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 Apr 24 19:19:44 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:45 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-fd895938-38f9-4624-96b5-17dbaaa527fc" returned: 0 in 0.601s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Lock "cinder-quobyte-fd895938-38f9-4624-96b5-17dbaaa527fc" released by "delete_volume" :: held 1.167s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d11dc6aa-95f1-4f50-aab4-fd8d9ce2c570 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d11dc6aa-95f1-4f50-aab4-fd8d9ce2c570 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d11dc6aa-95f1-4f50-aab4-fd8d9ce2c570 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d11dc6aa-95f1-4f50-aab4-fd8d9ce2c570 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d11dc6aa-95f1-4f50-aab4-fd8d9ce2c570 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d11dc6aa-95f1-4f50-aab4-fd8d9ce2c570 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Created reservations ['cae3c9bc-d34a-4ca2-b16a-201d811d1c3f', 'ce3001bc-9258-4202-b3ed-0d79abc4b1b7', '7bb46c85-b096-4bbb-8bbe-f14ae7c13aa0', 'a57845bc-24ab-4500-9247-335f4e81a0d7'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:45 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:45 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:45 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:45 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:45 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9" returned: 0 in 0.578s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9884ac-023f-459d-a334-0e5e5176cf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1042b571-3fa8-48ed-9e38-ffb6fb975e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:45 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Volume volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 (b350ef66-294d-423a-aa2d-6c6bb083e8d9): created successfully Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1042b571-3fa8-48ed-9e38-ffb6fb975e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Flow 'volume_create_manager' (7868b39c-8884-43b3-9677-1e24d9adc560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:45 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-64e467b1-cfea-4d61-93e5-98b9ff819f54 tempest-VolumeQuotasAdminTestJSON-350967504 None] Created volume successfully. Apr 24 19:19:45 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d11dc6aa-95f1-4f50-aab4-fd8d9ce2c570 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.460s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-d11dc6aa-95f1-4f50-aab4-fd8d9ce2c570 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:45 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d11dc6aa-95f1-4f50-aab4-fd8d9ce2c570 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Retype volume completed successfully. Apr 24 19:19:45 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.455s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:45 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Deleted volume successfully. Apr 24 19:19:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7d7365ea-55ba-4a34-8f9b-e98c32092f9a tempest-VolumesListTestJSON-664647825 None] Lock "cinder-fd895938-38f9-4624-96b5-17dbaaa527fc-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "cinder-afc41895-ed82-4843-9a38-7370f3671c6b-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Lock "cinder-afc41895-ed82-4843-9a38-7370f3671c6b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "cinder-quobyte-afc41895-ed82-4843-9a38-7370f3671c6b" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Lock "cinder-quobyte-afc41895-ed82-4843-9a38-7370f3671c6b" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1c103-0a40-4c06-a746-0cc51a099aa0]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:46 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b Apr 24 19:19:46 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Acquiring lock "cinder-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "cinder-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Acquiring lock "cinder-quobyte-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "cinder-quobyte-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[28613d1c-00b7-4993-8306-bb46994e9798]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:46 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 Apr 24 19:19:46 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:46 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-76540269-7492-482f-86e9-33636d8d9805 tempest-VolumeQuotasAdminTestJSON-264502211 None] Transfer volume completed successfully. Apr 24 19:19:46 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b" returned: 0 in 0.612s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:46 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b Apr 24 19:19:46 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:47 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6" returned: 0 in 0.576s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:47 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6 Apr 24 19:19:47 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:47 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-afc41895-ed82-4843-9a38-7370f3671c6b" returned: 0 in 0.553s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Lock "cinder-quobyte-afc41895-ed82-4843-9a38-7370f3671c6b" released by "delete_volume" :: held 1.227s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Created reservations ['94b0e9c1-88cb-4c7b-a4a7-55813e24f558', 'da184dde-f471-41d7-99fb-e365d2170382', '89effe1a-2ec1-4952-ad20-9c0cee1dab13', '47473e8f-a40e-4e9a-87f5-1414e27b04e0'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:47 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:47 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:47 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6" returned: 0 in 0.591s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "cinder-quobyte-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6" released by "delete_volume" :: held 1.219s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:47 devstack cinder-volume[81522]: WARNING cinder.quota [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:19:47 devstack cinder-volume[81522]: WARNING cinder.quota [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Created reservations ['2a65ef37-c38b-4c0c-9e40-43e80302e1ad', '57e11d09-ecb5-4a36-bdb2-a5c76e22aa30', '62123581-30e5-41c2-b008-d4ad01e1d83c', 'ad65c1df-0e6a-467b-8539-43c127f53eed'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Acquiring lock "cinder-b350ef66-294d-423a-aa2d-6c6bb083e8d9-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:47 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:47 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Lock "cinder-b350ef66-294d-423a-aa2d-6c6bb083e8d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Acquiring lock "cinder-quobyte-b350ef66-294d-423a-aa2d-6c6bb083e8d9" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Lock "cinder-quobyte-b350ef66-294d-423a-aa2d-6c6bb083e8d9" acquired by "delete_volume" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[95073127-13e5-4b28-8321-722386dac4ef]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:48 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 Apr 24 19:19:48 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:48 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.527s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:48 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Deleted volume successfully. Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6f250c02-b5e2-4c0e-b2f0-1d02d5d4dbb3 tempest-VolumesListTestJSON-664647825 None] Lock "cinder-afc41895-ed82-4843-9a38-7370f3671c6b-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:48 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.594s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:48 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Deleted volume successfully. Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-cc46ff0c-0429-4aa1-b5bd-4098a7a1d838 tempest-VolumeRetypeWithoutMigrationTest-1167919332 None] Lock "cinder-e7aba03d-6bb3-4001-b3e6-ec4f4e066bc6-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:48 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9" returned: 0 in 0.641s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:48 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9 Apr 24 19:19:48 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:49 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b350ef66-294d-423a-aa2d-6c6bb083e8d9" returned: 0 in 0.602s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Lock "cinder-quobyte-b350ef66-294d-423a-aa2d-6c6bb083e8d9" released by "delete_volume" :: held 1.307s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:49 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Created reservations ['12c447b1-b178-429c-b217-5b3724582b6c', '49a194b7-0335-4f36-a533-44445adfc233', '3650f9fa-17a8-4ab6-a6a2-c4a6a711bdf0', '3b205802-295c-435a-86cd-2733c1b4f258'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:49 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:19:49 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:50 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.580s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:50 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:50 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Deleted volume successfully. Apr 24 19:19:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82013b22-6bf9-472b-aa9b-6146eeeb4d0b tempest-VolumeQuotasAdminTestJSON-1566680503 None] Lock "cinder-b350ef66-294d-423a-aa2d-6c6bb083e8d9-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (837de1a6-82f8-4571-8947-be2235b62e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b725d4-67a7-43fd-a181-203320722e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b725d4-67a7-43fd-a181-203320722e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-9499303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e31c3-272b-40d1-a010-0dc6e40ac310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:53Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4527ecf1-0fad-427d-a87f-845b8098e69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4527ecf1-0fad-427d-a87f-845b8098e69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c43e92-471c-4ad3-9727-9b80c064308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c43e92-471c-4ad3-9727-9b80c064308c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513e31c3-272b-40d1-a010-0dc6e40ac310', 'volume_name': 'volume-513e31c3-272b-40d1-a010-0dc6e40ac310', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95063f2-8f28-4cf9-8bfb-b5a175ba2332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95063f2-8f28-4cf9-8bfb-b5a175ba2332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371d0158-883e-4538-a2a2-9534eee44c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Volume 513e31c3-272b-40d1-a010-0dc6e40ac310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513e31c3-272b-40d1-a010-0dc6e40ac310', 'volume_size': 1} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-9499303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e31c3-272b-40d1-a010-0dc6e40ac310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:53Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Creating volume 513e31c3-272b-40d1-a010-0dc6e40ac310 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:52 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:52 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310 1073741824 Apr 24 19:19:52 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (6a5a36d8-2dce-4972-a569-af968335f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d420b1-71fe-4b1a-b52c-2dda2b11de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d420b1-71fe-4b1a-b52c-2dda2b11de5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143724097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:53Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a973f00-c36d-4447-8d1b-27452398f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a973f00-c36d-4447-8d1b-27452398f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b4a670-222a-488d-b614-31d88b1c4bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b4a670-222a-488d-b614-31d88b1c4bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91', 'volume_name': 'volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9163a0a3-6530-4c2d-82b7-e37cd5e0984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9163a0a3-6530-4c2d-82b7-e37cd5e0984c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c39c50-84e3-453c-9a40-e252c2aede85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Volume aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91', 'volume_size': 1} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (d0f81ffd-ec16-486f-a26f-34d7dba2c0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da85271b-5d7d-4bf3-ad2b-31263049bb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da85271b-5d7d-4bf3-ad2b-31263049bb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501527877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb5db90-b831-4b89-9afb-cd197b79fb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:53Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98c75f7-4898-4930-a3b4-d8e9afa08e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98c75f7-4898-4930-a3b4-d8e9afa08e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735a31a3-7dfa-4e5e-b9d5-3ccdf6f61f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735a31a3-7dfa-4e5e-b9d5-3ccdf6f61f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb5db90-b831-4b89-9afb-cd197b79fb46', 'volume_name': 'volume-5bb5db90-b831-4b89-9afb-cd197b79fb46', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb041c9-9480-4178-8350-c1e50b2beed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb041c9-9480-4178-8350-c1e50b2beed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bf23be-5d25-4e0c-8a7a-adc6762ae3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Volume 5bb5db90-b831-4b89-9afb-cd197b79fb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb5db90-b831-4b89-9afb-cd197b79fb46', 'volume_size': 1} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (170cb166-7ea7-4ac7-a972-a1f5bb523672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1eaab5-0827-46e3-be47-29c168cf0a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1eaab5-0827-46e3-be47-29c168cf0a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633140672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427dd8eb-cbc3-4267-acf9-09e91d8b22cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:54Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c00100-7e88-4459-bfe0-a3f05a0d5727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c00100-7e88-4459-bfe0-a3f05a0d5727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b081db0a-7906-4c57-9962-0fabffd2496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b081db0a-7906-4c57-9962-0fabffd2496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427dd8eb-cbc3-4267-acf9-09e91d8b22cc', 'volume_name': 'volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc8cc25-b1ad-4d7e-b26b-f7aa2d8083fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:54 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc8cc25-b1ad-4d7e-b26b-f7aa2d8083fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f7aae9-0a3a-474d-a01c-b88bdd4789c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:54 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Volume 427dd8eb-cbc3-4267-acf9-09e91d8b22cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc', 'volume_size': 1} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310 1073741824" returned: 0 in 1.137s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:54 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310 Apr 24 19:19:54 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (bb0c226f-b9c7-4fe6-9e74-3313b82bfcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df36474-60f9-48f2-acbd-f243ca51c44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df36474-60f9-48f2-acbd-f243ca51c44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372141572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e50a0b-ad2d-417a-8c23-4c0c373946d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:54Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ed012d-75fa-47f1-8f54-4a5fddf67c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ed012d-75fa-47f1-8f54-4a5fddf67c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6297e26-db18-426e-8e76-9c46cc5354ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6297e26-db18-426e-8e76-9c46cc5354ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e50a0b-ad2d-417a-8c23-4c0c373946d0', 'volume_name': 'volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e2f840-d449-4c60-b088-fdc64d06f499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e2f840-d449-4c60-b088-fdc64d06f499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc9509c-fd4d-45f5-9090-1b3fe2bda167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:54 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Volume 25e50a0b-ad2d-417a-8c23-4c0c373946d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0', 'volume_size': 1} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:54 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310" returned: 0 in 0.614s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143724097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:53Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Creating volume aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:54 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371d0158-883e-4538-a2a2-9534eee44c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513e31c3-272b-40d1-a010-0dc6e40ac310', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:54 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 1073741824 Apr 24 19:19:54 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a928f1-3afd-4f59-8b55-4a14f05b815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:54 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Volume volume-513e31c3-272b-40d1-a010-0dc6e40ac310 (513e31c3-272b-40d1-a010-0dc6e40ac310): created successfully Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a928f1-3afd-4f59-8b55-4a14f05b815f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (837de1a6-82f8-4571-8947-be2235b62e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:54 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-14d1334a-6214-46cf-b3eb-86fa0aa25079 tempest-CreateVolumesFromImageTest-556325986 None] Created volume successfully. Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Flow 'volume_create_manager' (460b1b3b-4a60-4e4b-a3eb-f491368aec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ba1476-9aeb-4fef-a57f-748cd724c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ba1476-9aeb-4fef-a57f-748cd724c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-387659901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630b8ea2-f10a-4cda-97cd-11daf93c29bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a02ab0a7cc45acb1d45d18f5a59f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:55Z,use_quota=True,user_id='6f8c8a5fdc3d450f83d12de6334f8640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9239163a-69ad-40c0-b85a-c08fd510d5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9239163a-69ad-40c0-b85a-c08fd510d5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e39b15-959f-4cd1-bf1f-a4f95047da99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e39b15-959f-4cd1-bf1f-a4f95047da99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '630b8ea2-f10a-4cda-97cd-11daf93c29bb', 'volume_name': 'volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8289ff6c-3ced-41e8-b9d6-5037988bccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8289ff6c-3ced-41e8-b9d6-5037988bccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a4e594-bf65-475c-899d-eb87ef7d1d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:55 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Volume 630b8ea2-f10a-4cda-97cd-11daf93c29bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb', 'volume_size': 1} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:55 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 1073741824" returned: 0 in 0.915s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:55 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 Apr 24 19:19:55 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:56 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91" returned: 0 in 0.484s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.686s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501527877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb5db90-b831-4b89-9afb-cd197b79fb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:53Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Creating volume 5bb5db90-b831-4b89-9afb-cd197b79fb46 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:56 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c39c50-84e3-453c-9a40-e252c2aede85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f6fb13-98df-422f-9852-3181fa7822c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:56 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 1073741824 Apr 24 19:19:56 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:56 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Volume volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 (aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91): created successfully Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f6fb13-98df-422f-9852-3181fa7822c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (6a5a36d8-2dce-4972-a569-af968335f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:56 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0c518059-bd6c-4005-baa4-8721df07d527 tempest-CreateVolumesFromImageTest-556325986 None] Created volume successfully. Apr 24 19:19:56 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 1073741824" returned: 0 in 0.805s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:57 devstack sudo[87750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 Apr 24 19:19:57 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:57 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46" returned: 0 in 0.586s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.569s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633140672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427dd8eb-cbc3-4267-acf9-09e91d8b22cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:54Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Creating volume 427dd8eb-cbc3-4267-acf9-09e91d8b22cc {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:57 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:57 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc 1073741824 Apr 24 19:19:57 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bf23be-5d25-4e0c-8a7a-adc6762ae3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb5db90-b831-4b89-9afb-cd197b79fb46', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d341aef4-0989-4321-be42-55fd5ad56b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:57 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Volume volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 (5bb5db90-b831-4b89-9afb-cd197b79fb46): created successfully Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d341aef4-0989-4321-be42-55fd5ad56b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:57 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (d0f81ffd-ec16-486f-a26f-34d7dba2c0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:57 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5d44ab3c-cfa9-4b4b-ad9f-202d47fb7b90 tempest-CreateVolumesFromImageTest-556325986 None] Created volume successfully. Apr 24 19:19:58 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc 1073741824" returned: 0 in 0.747s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:58 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc Apr 24 19:19:58 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:58 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc" returned: 0 in 0.590s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.559s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372141572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e50a0b-ad2d-417a-8c23-4c0c373946d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeeea88f021421793ac0e0b06b7d0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:54Z,use_quota=True,user_id='02a16eb8cd434e0abad0bc055d68a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Creating volume 25e50a0b-ad2d-417a-8c23-4c0c373946d0 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:58 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:19:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:59 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 1073741824 Apr 24 19:19:59 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f7aae9-0a3a-474d-a01c-b88bdd4789c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cf4f29-3c1a-445d-8c55-860605df2875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:59 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Volume volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc (427dd8eb-cbc3-4267-acf9-09e91d8b22cc): created successfully Apr 24 19:19:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cf4f29-3c1a-445d-8c55-860605df2875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (170cb166-7ea7-4ac7-a972-a1f5bb523672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-80fcbd7b-f27a-446a-9476-51633cf0a43a tempest-CreateVolumesFromImageTest-556325986 None] Created volume successfully. Apr 24 19:19:59 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 1073741824" returned: 0 in 0.858s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:59 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 Apr 24 19:19:59 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:00 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0" returned: 0 in 0.566s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.999s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-387659901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630b8ea2-f10a-4cda-97cd-11daf93c29bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a02ab0a7cc45acb1d45d18f5a59f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:55Z,use_quota=True,user_id='6f8c8a5fdc3d450f83d12de6334f8640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Creating volume 630b8ea2-f10a-4cda-97cd-11daf93c29bb {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:00 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc9509c-fd4d-45f5-9090-1b3fe2bda167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2141b342-4ff6-4f76-82a0-79ed1c299c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:00 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb 1073741824 Apr 24 19:20:00 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:00 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Volume volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 (25e50a0b-ad2d-417a-8c23-4c0c373946d0): created successfully Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2141b342-4ff6-4f76-82a0-79ed1c299c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Flow 'volume_create_manager' (bb0c226f-b9c7-4fe6-9e74-3313b82bfcb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:00 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-131577c9-a546-4a18-80ba-9ff219c66b5b tempest-CreateVolumesFromImageTest-556325986 None] Created volume successfully. Apr 24 19:20:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-25e50a0b-ad2d-417a-8c23-4c0c373946d0-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-25e50a0b-ad2d-417a-8c23-4c0c373946d0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-quobyte-25e50a0b-ad2d-417a-8c23-4c0c373946d0" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-25e50a0b-ad2d-417a-8c23-4c0c373946d0" acquired by "delete_volume" :: waited 0.026s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:01 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed8e6f7-9c1a-46fa-805e-c00050612a29]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:01 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 Apr 24 19:20:01 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:01 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb 1073741824" returned: 0 in 0.915s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:01 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb Apr 24 19:20:01 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:02 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0" returned: 0 in 0.794s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:02 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0 Apr 24 19:20:02 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:02 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb" returned: 0 in 0.805s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a4e594-bf65-475c-899d-eb87ef7d1d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5860102c-0b81-45c2-b780-c492a39413f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:02 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Volume volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb (630b8ea2-f10a-4cda-97cd-11daf93c29bb): created successfully Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5860102c-0b81-45c2-b780-c492a39413f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Flow 'volume_create_manager' (460b1b3b-4a60-4e4b-a3eb-f491368aec38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:02 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5463a2f4-28cd-490c-819a-08e2116a2488 tempest-VolumesServicesTestJSON-1030863731 None] Created volume successfully. Apr 24 19:20:02 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-25e50a0b-ad2d-417a-8c23-4c0c373946d0" returned: 0 in 0.540s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-25e50a0b-ad2d-417a-8c23-4c0c373946d0" released by "delete_volume" :: held 1.394s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Created reservations ['f3486520-41ca-4c4e-b9ab-2d5e904a9079', 'c60d611e-8e5e-4703-b326-374ff810e8e2', 'fd21a1e8-25eb-4b06-8bd5-b0612144f87f', '16284b78-b470-416c-86c2-69cf45c56cd3'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:02 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:02 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Acquiring lock "cinder-630b8ea2-f10a-4cda-97cd-11daf93c29bb-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Lock "cinder-630b8ea2-f10a-4cda-97cd-11daf93c29bb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Acquiring lock "cinder-quobyte-630b8ea2-f10a-4cda-97cd-11daf93c29bb" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:03 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.635s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Lock "cinder-quobyte-630b8ea2-f10a-4cda-97cd-11daf93c29bb" acquired by "delete_volume" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:03 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Deleted volume successfully. Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a44d06c-0a49-40f2-9569-029c69112cdf]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-427dd8eb-cbc3-4267-acf9-09e91d8b22cc-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e10c4fc3-b57a-4035-81e2-46e736d9ae03 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-25e50a0b-ad2d-417a-8c23-4c0c373946d0-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-427dd8eb-cbc3-4267-acf9-09e91d8b22cc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-quobyte-427dd8eb-cbc3-4267-acf9-09e91d8b22cc" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-427dd8eb-cbc3-4267-acf9-09e91d8b22cc" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:03 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb Apr 24 19:20:03 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a45fe58-0774-4de4-b4a9-83240b4cce99]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:03 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc Apr 24 19:20:03 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:04 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb" returned: 0 in 0.695s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:04 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb Apr 24 19:20:04 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:04 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc" returned: 0 in 0.682s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:04 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc Apr 24 19:20:04 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:04 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-630b8ea2-f10a-4cda-97cd-11daf93c29bb" returned: 0 in 0.566s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Lock "cinder-quobyte-630b8ea2-f10a-4cda-97cd-11daf93c29bb" released by "delete_volume" :: held 1.324s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Created reservations ['1c905e8b-0af0-4c0f-a330-51c934786258', '7c2bf8ca-3587-49c1-8ec0-960352250726', '5b8b8efc-0f04-4663-9037-d52ea311a845', 'dca86fdc-f3f3-4990-9479-e2970f867d88'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:04 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-427dd8eb-cbc3-4267-acf9-09e91d8b22cc" returned: 0 in 0.573s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-427dd8eb-cbc3-4267-acf9-09e91d8b22cc" released by "delete_volume" :: held 1.301s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:04 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:04 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Created reservations ['adc2c45b-6abb-4cf0-b6d1-f50102285391', 'ad6afc35-825e-4c9f-8f93-7efbc01e1d41', '92d084e3-a9be-41b2-8b16-8738575d2d37', '00554fb2-f32a-401d-9490-8b4167756e51'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:04 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:04 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:05 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.565s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:05 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Deleted volume successfully. Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2fce42c6-fc69-4ecc-ad1c-7e4d53273e0f tempest-VolumesServicesTestJSON-1030863731 None] Lock "cinder-630b8ea2-f10a-4cda-97cd-11daf93c29bb-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:05 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.584s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:05 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Deleted volume successfully. Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-18eb0306-18bc-425b-9081-0341d18b38f9 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-427dd8eb-cbc3-4267-acf9-09e91d8b22cc-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-5bb5db90-b831-4b89-9afb-cd197b79fb46-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-5bb5db90-b831-4b89-9afb-cd197b79fb46-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-quobyte-5bb5db90-b831-4b89-9afb-cd197b79fb46" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-5bb5db90-b831-4b89-9afb-cd197b79fb46" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:05 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[063f7dda-5971-4341-a63b-4e89b198fcc7]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:06 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 Apr 24 19:20:06 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:06 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46" returned: 0 in 0.624s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:06 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46 Apr 24 19:20:06 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:07 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-5bb5db90-b831-4b89-9afb-cd197b79fb46" returned: 0 in 0.540s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-5bb5db90-b831-4b89-9afb-cd197b79fb46" released by "delete_volume" :: held 1.224s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:07 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Created reservations ['cbc308f3-b620-4aa3-8349-aefb194334a4', '54f64257-412c-4fa7-8fa8-3af9a0e921b9', '3be5e086-c64e-49c2-9f36-a4aac76308ad', '9830e8c7-7fbb-4a5c-9e5d-e5b0f79f3f5f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:07 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:07 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:08 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.730s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:08 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Deleted volume successfully. Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-05bcb06e-f294-420f-8986-fb82c38db0cf tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-5bb5db90-b831-4b89-9afb-cd197b79fb46-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-quobyte-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6e5efc-eb82-4886-8ac4-2bccb2a5ebd8]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:08 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 Apr 24 19:20:08 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:08 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91" returned: 0 in 0.599s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:08 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91 Apr 24 19:20:08 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:09 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91" returned: 0 in 0.579s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:09 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91" released by "delete_volume" :: held 1.242s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:09 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Created reservations ['5d3ae9dd-2e6c-4dcc-a9a1-80a8561e6aec', '5ebf899e-7b41-4348-a427-152da5a4c687', 'c16a97d8-9da8-440c-9216-5687ee1332c7', '137de542-0ddc-49b0-b0a2-ee41615592ef'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:09 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:09 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:10 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.601s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:10 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Deleted volume successfully. Apr 24 19:20:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-13d15d11-2695-4a1a-8d81-2361c93b3094 tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-aa2e44ca-7d34-4cfb-bf0e-5d6430b39f91-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-513e31c3-272b-40d1-a010-0dc6e40ac310-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-513e31c3-272b-40d1-a010-0dc6e40ac310-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "cinder-quobyte-513e31c3-272b-40d1-a010-0dc6e40ac310" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-513e31c3-272b-40d1-a010-0dc6e40ac310" acquired by "delete_volume" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:10 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa470d6-b837-4794-a430-2b3fc64ae040]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:10 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310 Apr 24 19:20:10 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:11 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310" returned: 0 in 0.750s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:11 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310 Apr 24 19:20:11 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:11 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-513e31c3-272b-40d1-a010-0dc6e40ac310" returned: 0 in 0.508s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-quobyte-513e31c3-272b-40d1-a010-0dc6e40ac310" released by "delete_volume" :: held 1.312s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Created reservations ['a7a125bb-370e-431e-a04a-6cbb669f7d41', '15bb54ff-8400-4529-af34-35f39a2ef7f2', 'a0eff914-ba7b-4690-959e-794e10e0f908', '76d79efd-28cb-4e98-a3db-d4d7552f29d6'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:12 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:12 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:12 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.655s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:12 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Deleted volume successfully. Apr 24 19:20:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2e298ebb-539b-4ae2-91a2-d82d56cebc2d tempest-CreateVolumesFromImageTest-556325986 None] Lock "cinder-513e31c3-272b-40d1-a010-0dc6e40ac310-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Flow 'volume_create_manager' (75e025c1-aa6d-4353-81ee-1231fc40259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c0ee10-68e1-4a28-ae52-4e2d662b3799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c0ee10-68e1-4a28-ae52-4e2d662b3799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2053198727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84188062-6a06-4e17-a130-da5cdc4db83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7675f203014bd2b1e0530a16265671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:17Z,use_quota=True,user_id='6424f4ddc4f94c92b9a19b66860cdb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674690bc-8520-4870-a9dd-e3696bf96893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674690bc-8520-4870-a9dd-e3696bf96893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79d436f-907f-4c79-b000-d49a8c7880e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79d436f-907f-4c79-b000-d49a8c7880e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84188062-6a06-4e17-a130-da5cdc4db83a', 'volume_name': 'volume-84188062-6a06-4e17-a130-da5cdc4db83a', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd6be39-aa6c-4797-b64e-d6a96c5ccb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd6be39-aa6c-4797-b64e-d6a96c5ccb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e3c454-1d56-462d-bbe4-9cac66a28f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:16 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Volume 84188062-6a06-4e17-a130-da5cdc4db83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84188062-6a06-4e17-a130-da5cdc4db83a', 'volume_size': 1} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2053198727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84188062-6a06-4e17-a130-da5cdc4db83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7675f203014bd2b1e0530a16265671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:17Z,use_quota=True,user_id='6424f4ddc4f94c92b9a19b66860cdb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Creating volume 84188062-6a06-4e17-a130-da5cdc4db83a {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:16 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:20:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:16 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a 1073741824 Apr 24 19:20:16 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:17 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a 1073741824" returned: 0 in 0.747s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:17 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a Apr 24 19:20:17 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:17 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a" returned: 0 in 0.465s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e3c454-1d56-462d-bbe4-9cac66a28f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84188062-6a06-4e17-a130-da5cdc4db83a', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53207177-5591-4a97-acff-ed2df507da91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:17 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Volume volume-84188062-6a06-4e17-a130-da5cdc4db83a (84188062-6a06-4e17-a130-da5cdc4db83a): created successfully Apr 24 19:20:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53207177-5591-4a97-acff-ed2df507da91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Flow 'volume_create_manager' (75e025c1-aa6d-4353-81ee-1231fc40259b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:17 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-1132260d-be4e-4b9e-80e9-72ca705f39f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Created volume successfully. Apr 24 19:20:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Creating offline snapshot 4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 of volume 84188062-6a06-4e17-a130-da5cdc4db83a {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:20:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0932a9d7-33a3-4e73-a0b3-b29721ad6c46]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:19 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a Apr 24 19:20:19 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:19 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a" returned: 0 in 0.556s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:19 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 1G Apr 24 19:20:19 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:20 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 1G" returned: 0 in 0.741s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84188062-6a06-4e17-a130-da5cdc4db83a -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:20 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84188062-6a06-4e17-a130-da5cdc4db83a -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 Apr 24 19:20:20 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:20 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84188062-6a06-4e17-a130-da5cdc4db83a -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01" returned: 0 in 0.577s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:20 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 is being set with open permissions: ugo+rw Apr 24 19:20:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:20 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 Apr 24 19:20:20 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:21 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:21 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:21 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01" returned: 0 in 0.540s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:21 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.info Apr 24 19:20:21 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:21 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.541s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:21 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:22 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.info" returned: 0 in 0.495s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:22 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.info is being set with open permissions: ugo+rw Apr 24 19:20:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:22 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.info Apr 24 19:20:22 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:22 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.info" returned: 0 in 0.562s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.606s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:22 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-430f784f-f13e-4541-bf2e-ce212b213001 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Create snapshot completed successfully Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Acquiring lock "cinder-4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Acquiring lock "cinder-quobyte-84188062-6a06-4e17-a130-da5cdc4db83a" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-quobyte-84188062-6a06-4e17-a130-da5cdc4db83a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Acquiring lock "cinder-quobyte-4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-quobyte-4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Deleting offline snapshot 4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 of volume 84188062-6a06-4e17-a130-da5cdc4db83a {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] snapshot_file for this snap is: volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf4c653-3bb2-4e0b-bc68-43cf06c07ced]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:23 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 Apr 24 19:20:23 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:24 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01" returned: 0 in 0.634s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84188062-6a06-4e17-a130-da5cdc4db83a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:20:24 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ef30b2-fa96-4d46-a121-2e6a8d953696]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:24 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a Apr 24 19:20:24 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:24 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a" returned: 0 in 0.587s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:24 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 Apr 24 19:20:24 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:25 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01" returned: 0 in 0.629s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:25 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01 Apr 24 19:20:25 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:26 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a.4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01" returned: 0 in 0.560s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-quobyte-4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01" released by "_delete_snapshot" :: held 2.516s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-quobyte-84188062-6a06-4e17-a130-da5cdc4db83a" released by "delete_snapshot" :: held 2.546s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Created reservations ['2abcc792-ee74-482d-9405-07e95e7dffc5', '3890ef7e-f30b-4eb0-a3cf-9c2fc4d6f66c', '73c69c0e-dbc0-4d4d-b214-140df3441372', 'a0130d52-c25c-4352-bb59-fb8663fc7f81'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:26 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Delete snapshot completed successfully. Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-28e0fe25-f614-45e8-8315-aa63d9def65e tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-4e5d3684-9ec2-40eb-9846-f7b6b5fa8e01-delete_snapshot" released by "delete_snapshot" :: held 2.718s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Acquiring lock "cinder-84188062-6a06-4e17-a130-da5cdc4db83a-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-84188062-6a06-4e17-a130-da5cdc4db83a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Acquiring lock "cinder-quobyte-84188062-6a06-4e17-a130-da5cdc4db83a" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-quobyte-84188062-6a06-4e17-a130-da5cdc4db83a" acquired by "delete_volume" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc42c38c-7c45-4a78-ba0b-831ea4bf748a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:27 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a Apr 24 19:20:27 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:27 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a" returned: 0 in 0.718s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:27 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a Apr 24 19:20:27 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:28 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-84188062-6a06-4e17-a130-da5cdc4db83a" returned: 0 in 0.640s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-quobyte-84188062-6a06-4e17-a130-da5cdc4db83a" released by "delete_volume" :: held 1.454s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=131,cinder:UPDATE=187,cinder:INSERT=42,cinder:DELETE=13 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:UPDATE=190,cinder:SELECT=135,cinder:INSERT=43,cinder:DELETE=19 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Created reservations ['d95a5a2d-e355-4aea-9346-abd9bbcce996', '3bb7e879-7cd7-4a39-8fe2-edcaef1d219c', '4a792f84-c3dd-49ae-84eb-9c024fdbab77', '9f230725-720e-4a70-83ec-b7d42868bcd3'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:28 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:28 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:29 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.738s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:29 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Deleted volume successfully. Apr 24 19:20:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3c1fc58b-235e-4fc9-a19b-f81223a5aea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-125771530 None] Lock "cinder-84188062-6a06-4e17-a130-da5cdc4db83a-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:38 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:20:38 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Flow 'volume_create_manager' (3b26d643-9478-46fa-a5bb-5034d68199b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba0d876-5629-4671-a171-47d03c14bd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba0d876-5629-4671-a171-47d03c14bd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-188720182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da03e4f4-a05f-4317-b02d-7c174090a242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35144f736394edb86794b7742786a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:39Z,use_quota=True,user_id='417e1823f5944f14b3478434ed0202d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b726a06-601a-4e17-a31b-8d8eb2a09dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b726a06-601a-4e17-a31b-8d8eb2a09dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8abbac-5eb4-4a5f-b27b-d5df60d2cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG cinder.image.glance [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Creating Keystone auth plugin from conf {{(pid=81522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8abbac-5eb4-4a5f-b27b-d5df60d2cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da03e4f4-a05f-4317-b02d-7c174090a242', 'volume_name': 'volume-da03e4f4-a05f-4317-b02d-7c174090a242', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0072249c-5e20-4d1e-b878-8010b1eabbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0072249c-5e20-4d1e-b878-8010b1eabbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0094d4b-7096-4e89-9324-b8b8678d6487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:39 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Volume da03e4f4-a05f-4317-b02d-7c174090a242: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da03e4f4-a05f-4317-b02d-7c174090a242', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Trying to clone da03e4f4-a05f-4317-b02d-7c174090a242 from image 25434dbf-f589-4779-867c-1dfa660304ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]). {{(pid=81522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:20:39 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5b1e96-2c96-483c-bc14-b40543d6a2b3]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:39 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD Apr 24 19:20:39 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:40 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Temporary image 25434dbf-f589-4779-867c-1dfa660304ca is fetched for user 417e1823f5944f14b3478434ed0202d6. {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84bf1d2-723d-41d3-870c-3c00203c3a8d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:40 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD Apr 24 19:20:40 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:40 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-188720182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da03e4f4-a05f-4317-b02d-7c174090a242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35144f736394edb86794b7742786a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:39Z,use_quota=True,user_id='417e1823f5944f14b3478434ed0202d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Creating volume da03e4f4-a05f-4317-b02d-7c174090a242 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:40 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:20:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:40 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 1073741824 Apr 24 19:20:40 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:41 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 1073741824" returned: 0 in 0.664s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:41 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 Apr 24 19:20:41 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:42 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242" returned: 0 in 0.501s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:42 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Attempting download of 25434dbf-f589-4779-867c-1dfa660304ca ((None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}])) to volume da03e4f4-a05f-4317-b02d-7c174090a242. {{(pid=81522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:20:42 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1d358-768e-4917-989d-dc2ae9ef6774]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_wbj5z3p3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:42 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_wbj5z3p3 Apr 24 19:20:42 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:42 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_wbj5z3p3" returned: 0 in 0.487s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_wbj5z3p3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:42 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_wbj5z3p3 Apr 24 19:20:42 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:43 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_wbj5z3p3" returned: 1 in 0.545s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25434dbf-f589-4779-867c-1dfa660304ca_wbj5z3p3' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:20:43 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3508901b-eaf3-4c0c-bfd0-0e48fe2e09f9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:43 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD Apr 24 19:20:43 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:43 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:43 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] 25434dbf-f589-4779-867c-1dfa660304ca was qcow2, converting to raw {{(pid=81522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:20:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:43 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 Apr 24 19:20:43 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:45 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242" returned: 0 in 1.394s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:45 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25434dbf-f589-4779-867c-1dfa660304ca_o6f7o39hdevstack@QuobyteHD, size 112.00 MB, duration 1.40 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:20:45 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Converted 112.00 MB image at 80.26 MB/s Apr 24 19:20:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:45 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 1G Apr 24 19:20:45 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:45 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 1G" returned: 0 in 0.650s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:45 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c39738c-1856-4bd1-8937-b4860d1ba95d]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:45 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 Apr 24 19:20:45 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:46 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242" returned: 0 in 0.668s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:46 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 Apr 24 19:20:46 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:46 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242" returned: 1 in 0.588s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:20:46 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Downloaded image 25434dbf-f589-4779-867c-1dfa660304ca ((None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}])) to volume da03e4f4-a05f-4317-b02d-7c174090a242 successfully. {{(pid=81522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:20:46 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Temporary image 25434dbf-f589-4779-867c-1dfa660304ca for user 417e1823f5944f14b3478434ed0202d6 is deleted. {{(pid=81522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.volume.volume_utils [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Marking volume da03e4f4-a05f-4317-b02d-7c174090a242 as bootable. {{(pid=81522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Copying metadata from image 25434dbf-f589-4779-867c-1dfa660304ca to da03e4f4-a05f-4317-b02d-7c174090a242. {{(pid=81522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Creating volume glance metadata for volume da03e4f4-a05f-4317-b02d-7c174090a242 backed by image 25434dbf-f589-4779-867c-1dfa660304ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0094d4b-7096-4e89-9324-b8b8678d6487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da03e4f4-a05f-4317-b02d-7c174090a242', 'volume_size': 1, 'image_id': '25434dbf-f589-4779-867c-1dfa660304ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25434dbf-f589-4779-867c-1dfa660304ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4422fd670a394c9f9de8c4af198d6afc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25434dbf-f589-4779-867c-1dfa660304ca', 'created_at': datetime.datetime(2026, 4, 24, 17, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25434dbf-f589-4779-867c-1dfa660304ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c98046-95a8-4e64-9234-233376b708f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:47 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Volume volume-da03e4f4-a05f-4317-b02d-7c174090a242 (da03e4f4-a05f-4317-b02d-7c174090a242): created successfully Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c98046-95a8-4e64-9234-233376b708f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Flow 'volume_create_manager' (3b26d643-9478-46fa-a5bb-5034d68199b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:47 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d88e6d28-382b-43d8-8888-50d0be084ae2 tempest-VolumesImageMetadata-1147863555 None] Created volume successfully. Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Acquiring lock "cinder-da03e4f4-a05f-4317-b02d-7c174090a242-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Lock "cinder-da03e4f4-a05f-4317-b02d-7c174090a242-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Acquiring lock "cinder-quobyte-da03e4f4-a05f-4317-b02d-7c174090a242" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Lock "cinder-quobyte-da03e4f4-a05f-4317-b02d-7c174090a242" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ac78f5-f0d8-4bd7-a874-5ee6d561567b]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:48 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 Apr 24 19:20:48 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:48 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242" returned: 0 in 0.579s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:48 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 Apr 24 19:20:48 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (8aa26e22-e378-4ff7-b4b5-f9a0390d6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a10c085-99b8-417a-a1c2-b93caba23fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a10c085-99b8-417a-a1c2-b93caba23fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1066959984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:49Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df61ebeb-50f6-4810-a7aa-6afe08543b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df61ebeb-50f6-4810-a7aa-6afe08543b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac225f6-ba5e-4cc8-93c0-2b3a2aedf66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac225f6-ba5e-4cc8-93c0-2b3a2aedf66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0', 'volume_name': 'volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae49ab9-e6e2-497f-aa44-3ec689714560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae49ab9-e6e2-497f-aa44-3ec689714560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b462a13-9c2c-4828-8156-3d2953b77e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:48 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Volume 4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0', 'volume_size': 1} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1066959984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:49Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Creating volume 4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:48 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:20:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:48 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 1073741824 Apr 24 19:20:48 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:49 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242" returned: 1 in 0.620s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:49 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242 Apr 24 19:20:49 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:49 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 1073741824" returned: 0 in 0.744s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:49 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 Apr 24 19:20:49 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:49 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-da03e4f4-a05f-4317-b02d-7c174090a242" returned: 0 in 0.501s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Lock "cinder-quobyte-da03e4f4-a05f-4317-b02d-7c174090a242" released by "delete_volume" :: held 1.777s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Created reservations ['886dc531-6f01-43f3-91b6-bdd408a843f7', '278d9dbf-6f47-41ef-8aa1-25ea55562822', '3ebf08c6-5bb4-4ce7-ae8d-0b27e7b03ff1', '7ae8ed90-2956-423c-9a71-8a6233de97d4'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:49 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:49 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:50 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0" returned: 0 in 0.494s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b462a13-9c2c-4828-8156-3d2953b77e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602548b2-44a5-4b35-ad83-2cad43c5fbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:50 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Volume volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 (4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0): created successfully Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602548b2-44a5-4b35-ad83-2cad43c5fbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (8aa26e22-e378-4ff7-b4b5-f9a0390d6eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:50 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d2810069-8bef-430a-88f2-50933d7be5de tempest-VolumesActionsTest-202530879 None] Created volume successfully. Apr 24 19:20:50 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.493s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:50 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Deleted volume successfully. Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d47f7b9d-4105-4dd1-ad68-e2513d827e0e tempest-VolumesImageMetadata-1147863555 None] Lock "cinder-da03e4f4-a05f-4317-b02d-7c174090a242-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-9e861a82-5dba-4074-9353-27e1d101c96c tempest-VolumesActionsTest-202530879 None] Acquiring lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0" by "attach_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:50 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-9e861a82-5dba-4074-9353-27e1d101c96c tempest-VolumesActionsTest-202530879 None] Lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0" acquired by "attach_volume" :: waited 0.028s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:51 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9e861a82-5dba-4074-9353-27e1d101c96c tempest-VolumesActionsTest-202530879 None] Attaching volume 4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 to instance a4e3d858-773a-4dae-858f-328ae44e4a3f at mountpoint /dev/vdb on host None. Apr 24 19:20:51 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9e861a82-5dba-4074-9353-27e1d101c96c tempest-VolumesActionsTest-202530879 None] Attach volume completed successfully. Apr 24 19:20:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-9e861a82-5dba-4074-9353-27e1d101c96c tempest-VolumesActionsTest-202530879 None] Lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0" released by "attach_volume" :: held 0.136s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5a08c764-d47b-4475-8edb-bfcbf3ac1ca1 tempest-VolumesActionsTest-1730534465 None] Terminate volume connection completed successfully. Apr 24 19:20:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5a08c764-d47b-4475-8edb-bfcbf3ac1ca1 tempest-VolumesActionsTest-1730534465 None] Acquiring lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0-detach_volume" by "detach_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5a08c764-d47b-4475-8edb-bfcbf3ac1ca1 tempest-VolumesActionsTest-1730534465 None] Lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5a08c764-d47b-4475-8edb-bfcbf3ac1ca1 tempest-VolumesActionsTest-1730534465 None] Detaching volume 4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 from instance a4e3d858-773a-4dae-858f-328ae44e4a3f. Apr 24 19:20:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5a08c764-d47b-4475-8edb-bfcbf3ac1ca1 tempest-VolumesActionsTest-1730534465 None] Detach volume completed successfully. Apr 24 19:20:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5a08c764-d47b-4475-8edb-bfcbf3ac1ca1 tempest-VolumesActionsTest-1730534465 None] Lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82f0de33-8524-4145-88d5-8cb840698513 tempest-VolumesActionsTest-202530879 None] Acquiring lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0-detach_volume" by "detach_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82f0de33-8524-4145-88d5-8cb840698513 tempest-VolumesActionsTest-202530879 None] Lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:53 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-82f0de33-8524-4145-88d5-8cb840698513 tempest-VolumesActionsTest-202530879 None] Volume detach called, but volume not attached. Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82f0de33-8524-4145-88d5-8cb840698513 tempest-VolumesActionsTest-202530879 None] Lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Flow 'volume_create_manager' (10eea77f-b796-4eb6-8613-86f8567f81c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90674a94-b0df-459d-aeca-4a4bf8e4924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90674a94-b0df-459d-aeca-4a4bf8e4924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1385996999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48ff253-f26b-412c-9ae8-6a09793b2f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e04be559e04a44855be4532f22e420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:53Z,use_quota=True,user_id='8fb2868a360245df8b738200e35212c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5e66ac-9712-4691-9217-ed1f68a6fa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5e66ac-9712-4691-9217-ed1f68a6fa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96163208-708d-4545-b5ab-8a8d438af40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96163208-708d-4545-b5ab-8a8d438af40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48ff253-f26b-412c-9ae8-6a09793b2f8c', 'volume_name': 'volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f5419-6a4e-44e1-b23c-7bc06eeba088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f5419-6a4e-44e1-b23c-7bc06eeba088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c005ae-9fd9-4859-b9a8-9c1742c08989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Volume b48ff253-f26b-412c-9ae8-6a09793b2f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c', 'volume_size': 1} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1385996999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48ff253-f26b-412c-9ae8-6a09793b2f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e04be559e04a44855be4532f22e420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:53Z,use_quota=True,user_id='8fb2868a360245df8b738200e35212c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Creating volume b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:53 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:20:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:53 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c 1073741824 Apr 24 19:20:53 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Acquiring lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Acquiring lock "cinder-quobyte-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Lock "cinder-quobyte-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0" acquired by "delete_volume" :: waited 0.028s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abc4b7c-8b48-447e-ac4f-38b4e787598e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:54 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 Apr 24 19:20:54 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:54 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c 1073741824" returned: 0 in 0.781s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:54 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c Apr 24 19:20:54 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:54 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0" returned: 0 in 0.578s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:54 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0 Apr 24 19:20:54 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:54 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c" returned: 0 in 0.543s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c005ae-9fd9-4859-b9a8-9c1742c08989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9e4ca0-ccb0-4aec-869d-a132665c710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:55 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Volume volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c (b48ff253-f26b-412c-9ae8-6a09793b2f8c): created successfully Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9e4ca0-ccb0-4aec-869d-a132665c710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Flow 'volume_create_manager' (10eea77f-b796-4eb6-8613-86f8567f81c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:55 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e789b6f2-1c64-49a3-a414-5c41b007da09 tempest-VolumesDeleteCascade-840726671 None] Created volume successfully. Apr 24 19:20:55 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0" returned: 0 in 0.550s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Lock "cinder-quobyte-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0" released by "delete_volume" :: held 1.195s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Created reservations ['2af16601-df99-4696-98bd-5d0e94d6f7db', 'eb1ed9d0-58ae-47c7-83de-ccab78eb3ed2', '24ba0a34-9152-43e5-8040-08a1b34e4db0', '9d815655-8323-4208-85fa-383f69023cbf'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:55 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:20:55 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Creating offline snapshot da45e745-ea1a-4dbc-a7d8-34075d4e8697 of volume b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:20:56 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ec6e1-37bb-4604-8ffa-046086022b92]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:56 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.555s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:56 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c Apr 24 19:20:56 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:56 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:56 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Deleted volume successfully. Apr 24 19:20:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-478b91bb-e48f-47c3-85c1-3ba14c72c502 tempest-VolumesActionsTest-202530879 None] Lock "cinder-4b2f78a7-7102-4432-89d4-d8ab2e1e5ff0-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:56 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c" returned: 0 in 0.634s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:56 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 1G Apr 24 19:20:56 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:57 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 1G" returned: 0 in 0.688s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:57 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 Apr 24 19:20:57 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:57 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697" returned: 0 in 0.640s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:57 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 is being set with open permissions: ugo+rw Apr 24 19:20:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:58 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 Apr 24 19:20:58 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:58 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697" returned: 0 in 0.513s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:58 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.info Apr 24 19:20:58 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:58 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.info" returned: 0 in 0.464s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:58 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.info is being set with open permissions: ugo+rw Apr 24 19:20:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:59 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.info Apr 24 19:20:59 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:59 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.info" returned: 0 in 0.523s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.569s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d1fc23d9-d0e0-4062-a0e6-34ca326f0726 tempest-VolumesDeleteCascade-840726671 None] Create snapshot completed successfully Apr 24 19:21:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Creating offline snapshot 64419649-3a30-4e9d-abd6-60b0736867c5 of volume b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:21:00 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e822ce1f-4f09-43a3-9db5-2a2ac496b4a9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:00 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 Apr 24 19:21:00 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:00 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697" returned: 0 in 0.545s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:00 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 1G Apr 24 19:21:00 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:01 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 1G" returned: 0 in 0.668s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:01 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 Apr 24 19:21:01 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:02 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5" returned: 0 in 0.497s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:02 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 is being set with open permissions: ugo+rw Apr 24 19:21:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:02 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 Apr 24 19:21:02 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:02 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5" returned: 0 in 0.536s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:02 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a60c1f8a-bb04-47d5-9729-241d297fc70f tempest-VolumesDeleteCascade-840726671 None] Create snapshot completed successfully Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-b48ff253-f26b-412c-9ae8-6a09793b2f8c-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-b48ff253-f26b-412c-9ae8-6a09793b2f8c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Performing cascade delete. {{(pid=81522) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-64419649-3a30-4e9d-abd6-60b0736867c5-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-64419649-3a30-4e9d-abd6-60b0736867c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-b48ff253-f26b-412c-9ae8-6a09793b2f8c" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-b48ff253-f26b-412c-9ae8-6a09793b2f8c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-64419649-3a30-4e9d-abd6-60b0736867c5" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-64419649-3a30-4e9d-abd6-60b0736867c5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Deleting offline snapshot 64419649-3a30-4e9d-abd6-60b0736867c5 of volume b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] snapshot_file for this snap is: volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[38316ac3-2da2-4571-94cd-1ad676aaa5fa]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:03 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 Apr 24 19:21:03 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:04 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (bfb4aeea-1bbe-4af0-ab1b-81627396ba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d874254c-9e80-4a6d-a729-3216629ddc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5" returned: 0 in 0.649s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d874254c-9e80-4a6d-a729-3216629ddc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1417419955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:04Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a2b8a0-5d48-4cbb-ad46-1a9339b21b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a2b8a0-5d48-4cbb-ad46-1a9339b21b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4229a3-ab87-4d8d-ac32-cb679d3320b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4229a3-ab87-4d8d-ac32-cb679d3320b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236', 'volume_name': 'volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8b2a4f-3c8d-4db8-ac36-0a6f3c1a8224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8b2a4f-3c8d-4db8-ac36-0a6f3c1a8224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1231c990-07e5-44d2-b7f7-4756c31b6617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:04 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Volume 1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236', 'volume_size': 1} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1417419955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:04Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Creating volume 1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:04 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ea836b-e2eb-48a9-a3da-9ddcead88da6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:04 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 1073741824 Apr 24 19:21:04 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:04 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 Apr 24 19:21:04 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:05 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697" returned: 0 in 0.579s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:05 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 1073741824" returned: 0 in 0.613s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:05 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 Apr 24 19:21:05 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:05 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 Apr 24 19:21:05 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:05 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236" returned: 0 in 0.503s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1231c990-07e5-44d2-b7f7-4756c31b6617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbfa55e-9e00-4cb6-8010-44753082efd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:05 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Volume volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 (1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236): created successfully Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbfa55e-9e00-4cb6-8010-44753082efd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (bfb4aeea-1bbe-4af0-ab1b-81627396ba17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:05 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a86f532d-905f-43db-ac86-337a45582c56 tempest-VolumesActionsTest-202530879 None] Created volume successfully. Apr 24 19:21:05 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5" returned: 0 in 0.656s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:05 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5 Apr 24 19:21:05 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:06 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.64419649-3a30-4e9d-abd6-60b0736867c5" returned: 0 in 0.433s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-64419649-3a30-4e9d-abd6-60b0736867c5" released by "_delete_snapshot" :: held 2.487s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-b48ff253-f26b-412c-9ae8-6a09793b2f8c" released by "delete_snapshot" :: held 2.508s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Created reservations ['1790e448-5c1e-46b7-92ba-586d059efc76', '8e6cbdcd-50c0-4fc0-99ed-771a5551cfb2', '551104d7-6ed8-46a5-9bb7-d3d447ff53d6', '769ff5cd-e37a-4e1e-aead-15792fc745a3'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:06 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Delete snapshot completed successfully. Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-64419649-3a30-4e9d-abd6-60b0736867c5-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-da45e745-ea1a-4dbc-a7d8-34075d4e8697-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-da45e745-ea1a-4dbc-a7d8-34075d4e8697-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-b48ff253-f26b-412c-9ae8-6a09793b2f8c" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-b48ff253-f26b-412c-9ae8-6a09793b2f8c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-da45e745-ea1a-4dbc-a7d8-34075d4e8697" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-da45e745-ea1a-4dbc-a7d8-34075d4e8697" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Deleting offline snapshot da45e745-ea1a-4dbc-a7d8-34075d4e8697 of volume b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] snapshot_file for this snap is: volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d76cbe-ef9e-44f6-84f5-2f76050a61db]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:06 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 Apr 24 19:21:06 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Acquiring lock "cinder-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Lock "cinder-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Acquiring lock "cinder-quobyte-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Lock "cinder-quobyte-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb879226-39f5-4aa6-9f0a-79bd53bceac2]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:06 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 Apr 24 19:21:06 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:07 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697" returned: 0 in 0.586s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f2f20d-eed5-4de2-b157-25d1a5ef3e32]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:07 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c Apr 24 19:21:07 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:07 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236" returned: 0 in 0.561s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:07 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236 Apr 24 19:21:07 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:07 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c" returned: 0 in 0.575s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:07 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 Apr 24 19:21:07 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:07 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236" returned: 0 in 0.522s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Lock "cinder-quobyte-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236" released by "delete_volume" :: held 1.125s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:07 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Created reservations ['813cf38b-a833-407b-84f6-2cd7e64c4d00', '344c69b5-7e35-43a8-82da-ce39502b3e21', 'e219610d-63fc-4d4c-93d9-594dc481295b', '37824186-a54a-4219-9363-8054ecda34a0'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:08 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:08 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:08 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697" returned: 0 in 0.664s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:08 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697 Apr 24 19:21:08 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:08 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.517s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:08 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Deleted volume successfully. Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-173cd3f3-9a11-43ab-9ccd-e143a2deb11d tempest-VolumesActionsTest-1730534465 None] Lock "cinder-1cd9c11d-9907-4fa9-a7a3-7eb3c20ee236-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:08 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c.da45e745-ea1a-4dbc-a7d8-34075d4e8697" returned: 0 in 0.492s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-da45e745-ea1a-4dbc-a7d8-34075d4e8697" released by "_delete_snapshot" :: held 2.419s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-b48ff253-f26b-412c-9ae8-6a09793b2f8c" released by "delete_snapshot" :: held 2.453s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Created reservations ['7ad21b37-3d7b-4e21-ad0f-34530a100531', '8a65d018-df1b-49c1-b3c6-9e34a0dc6193', 'afe25209-1275-4a4c-9bf9-5f67db4727a3', '00c647c0-5196-4237-ad18-6452be4ea021'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:08 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Delete snapshot completed successfully. Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-da45e745-ea1a-4dbc-a7d8-34075d4e8697-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Snapshots deleted, issuing volume delete {{(pid=81522) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-b48ff253-f26b-412c-9ae8-6a09793b2f8c" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-b48ff253-f26b-412c-9ae8-6a09793b2f8c" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec9d388-f234-4542-9e00-7b7d14e9e162]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:09 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c Apr 24 19:21:09 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (f9ba9233-6b33-41b5-9b30-1cb29517ec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae304b5d-1b54-4925-8a1e-181ea9ba4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae304b5d-1b54-4925-8a1e-181ea9ba4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-908516932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca981103-f7d0-48ee-a564-bd3506c12de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:09Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5a969f-d459-40e3-9845-aa86bdc94304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5a969f-d459-40e3-9845-aa86bdc94304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68326554-26c8-4ad3-9fd3-7645492e9a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68326554-26c8-4ad3-9fd3-7645492e9a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca981103-f7d0-48ee-a564-bd3506c12de3', 'volume_name': 'volume-ca981103-f7d0-48ee-a564-bd3506c12de3', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4f9452-6ba2-4123-abb9-007749139ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4f9452-6ba2-4123-abb9-007749139ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d72a57-64cd-4223-b6c5-9a04b1969318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Volume ca981103-f7d0-48ee-a564-bd3506c12de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca981103-f7d0-48ee-a564-bd3506c12de3', 'volume_size': 1} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-908516932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca981103-f7d0-48ee-a564-bd3506c12de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:09Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Creating volume ca981103-f7d0-48ee-a564-bd3506c12de3 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:09 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:09 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3 1073741824 Apr 24 19:21:09 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:09 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c" returned: 0 in 0.625s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:09 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c Apr 24 19:21:09 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:10 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3 1073741824" returned: 0 in 0.661s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:10 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3 Apr 24 19:21:10 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:10 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-b48ff253-f26b-412c-9ae8-6a09793b2f8c" returned: 0 in 0.558s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-b48ff253-f26b-412c-9ae8-6a09793b2f8c" released by "delete_volume" :: held 1.264s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Created reservations ['9b7abeda-1ec9-462d-af8b-b2610330ee52', '539db8a0-3c31-43e4-8cbc-143c95b3fc79', '0701d6c6-c562-4844-99c9-e443b78ef675', 'edc697e7-9bbb-45c8-ae05-aff4a2440538'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:10 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:10 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:10 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3" returned: 0 in 0.497s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d72a57-64cd-4223-b6c5-9a04b1969318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca981103-f7d0-48ee-a564-bd3506c12de3', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800f7956-cf8c-430d-9b45-ca39a08771c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:10 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Volume volume-ca981103-f7d0-48ee-a564-bd3506c12de3 (ca981103-f7d0-48ee-a564-bd3506c12de3): created successfully Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800f7956-cf8c-430d-9b45-ca39a08771c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (f9ba9233-6b33-41b5-9b30-1cb29517ec0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-73e9ff95-3514-46bf-8546-45dfff8625dc tempest-VolumesActionsTest-202530879 None] Created volume successfully. Apr 24 19:21:10 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.448s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Deleted volume successfully. Apr 24 19:21:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fcc44714-99f8-44d8-bf4b-6f63577137e2 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-b48ff253-f26b-412c-9ae8-6a09793b2f8c-delete_volume" released by "delete_volume" :: held 7.286s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Acquiring lock "cinder-ca981103-f7d0-48ee-a564-bd3506c12de3-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Lock "cinder-ca981103-f7d0-48ee-a564-bd3506c12de3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Acquiring lock "cinder-quobyte-ca981103-f7d0-48ee-a564-bd3506c12de3" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Flow 'volume_create_manager' (d36e545b-84a2-4a9d-b523-7352632bc2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f8f4c7-e1ea-4898-985c-b47c3b723246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Lock "cinder-quobyte-ca981103-f7d0-48ee-a564-bd3506c12de3" acquired by "delete_volume" :: waited 0.051s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f8f4c7-e1ea-4898-985c-b47c3b723246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-829620648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e04be559e04a44855be4532f22e420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:12Z,use_quota=True,user_id='8fb2868a360245df8b738200e35212c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741b8db8-2df1-4e3e-b83c-c2ff450b3aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741b8db8-2df1-4e3e-b83c-c2ff450b3aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b75464-ab9f-4aeb-b183-a7b4a6955b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b75464-ab9f-4aeb-b183-a7b4a6955b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8baa5c6-45f1-47c1-b34c-9122a3bb8dc4', 'volume_name': 'volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3fb9dc-c5a5-4987-996b-52269e298f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3fb9dc-c5a5-4987-996b-52269e298f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6352fd6d-9745-4dac-8a76-f43026f66ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Volume d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4', 'volume_size': 1} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-829620648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e04be559e04a44855be4532f22e420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:12Z,use_quota=True,user_id='8fb2868a360245df8b738200e35212c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Creating volume d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:11 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ffa069-5a59-43f5-aa32-91565decc7c4]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:11 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 1073741824 Apr 24 19:21:11 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:11 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3 Apr 24 19:21:11 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:12 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3" returned: 0 in 0.562s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:12 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3 Apr 24 19:21:12 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:12 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 1073741824" returned: 0 in 0.663s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:12 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 Apr 24 19:21:12 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:12 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ca981103-f7d0-48ee-a564-bd3506c12de3" returned: 0 in 0.472s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Lock "cinder-quobyte-ca981103-f7d0-48ee-a564-bd3506c12de3" released by "delete_volume" :: held 1.126s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:12 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Created reservations ['d5eda3c1-99ff-4959-b3a3-a33444c345c1', 'b5026b41-1fff-46a7-bef5-775a6786d41b', '8265e930-9b15-4f7f-939a-cefb8dc69ad2', '80b4facb-297a-4216-865f-2014de674e8d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:13 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" returned: 0 in 0.474s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6352fd6d-9745-4dac-8a76-f43026f66ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb7c5dd-f85b-4dcb-9b93-1c4c51fcc59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:13 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Volume volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 (d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4): created successfully Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb7c5dd-f85b-4dcb-9b93-1c4c51fcc59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:13 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:13 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Flow 'volume_create_manager' (d36e545b-84a2-4a9d-b523-7352632bc2b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:13 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9bbfdcf4-9ae1-48a1-abbb-a82438931f67 tempest-VolumesDeleteCascade-840726671 None] Created volume successfully. Apr 24 19:21:13 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.421s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:13 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Deleted volume successfully. Apr 24 19:21:13 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4f159fbc-d84f-4496-972d-10a877e9012c tempest-VolumesActionsTest-1730534465 None] Lock "cinder-ca981103-f7d0-48ee-a564-bd3506c12de3-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Creating offline snapshot 998de0e3-1f6f-4116-a5b4-264b48baba5a of volume d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55b6efa-536b-4634-86f6-2f46e6f7fa0d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:14 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 Apr 24 19:21:14 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (df73b0ba-c949-44d8-ad82-b9de41cdfe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41244f05-0db9-4778-b1c2-48dfe33e5804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41244f05-0db9-4778-b1c2-48dfe33e5804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1879629002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251ddf5a-5335-410b-9999-e72cfe7499c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:14Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8551b3f-c195-4752-987a-eb46b311a305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8551b3f-c195-4752-987a-eb46b311a305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b79ef1-525e-48c7-93e3-fb75a356552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b79ef1-525e-48c7-93e3-fb75a356552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251ddf5a-5335-410b-9999-e72cfe7499c8', 'volume_name': 'volume-251ddf5a-5335-410b-9999-e72cfe7499c8', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97624581-05a5-44df-b503-3ccf9329a7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97624581-05a5-44df-b503-3ccf9329a7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a627a53-9cb3-4f85-b60c-405ddba2b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:14 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Volume 251ddf5a-5335-410b-9999-e72cfe7499c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251ddf5a-5335-410b-9999-e72cfe7499c8', 'volume_size': 1} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:14 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" returned: 0 in 0.538s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:14 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a 1G Apr 24 19:21:14 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:15 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a 1G" returned: 0 in 0.551s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:15 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a Apr 24 19:21:15 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:15 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a" returned: 0 in 0.451s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:15 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a is being set with open permissions: ugo+rw Apr 24 19:21:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:15 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a Apr 24 19:21:15 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:16 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a" returned: 0 in 0.403s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:16 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.info Apr 24 19:21:16 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:16 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.info" returned: 0 in 0.447s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:16 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.info is being set with open permissions: ugo+rw Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:16 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.info Apr 24 19:21:16 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:16 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.info" returned: 0 in 0.411s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.515s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1879629002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251ddf5a-5335-410b-9999-e72cfe7499c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:14Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Creating volume 251ddf5a-5335-410b-9999-e72cfe7499c8 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:16 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:21:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:16 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8 1073741824 Apr 24 19:21:16 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:16 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0959cad8-03d8-4860-8f1c-4e795f89d47d tempest-VolumesDeleteCascade-840726671 None] Create snapshot completed successfully Apr 24 19:21:17 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8 1073741824" returned: 0 in 0.724s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Flow 'volume_create_manager' (089af016-9436-43c6-85a1-a06a54b59eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846080b9-585b-4cbf-9fc1-c323e5895651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846080b9-585b-4cbf-9fc1-c323e5895651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1677431020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88aaf3c0-4239-4365-8003-e51b2780cf60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e04be559e04a44855be4532f22e420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=998de0e3-1f6f-4116-a5b4-264b48baba5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:18Z,use_quota=True,user_id='8fb2868a360245df8b738200e35212c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee2caaa-3080-4f9b-8e1e-d0a5aa4a2a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee2caaa-3080-4f9b-8e1e-d0a5aa4a2a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e0db15-840e-4ac8-acd3-f1ea81d0f4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e0db15-840e-4ac8-acd3-f1ea81d0f4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88aaf3c0-4239-4365-8003-e51b2780cf60', 'volume_name': 'volume-88aaf3c0-4239-4365-8003-e51b2780cf60', 'volume_size': 1, 'snapshot_id': '998de0e3-1f6f-4116-a5b4-264b48baba5a'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367e335c-287e-4685-b235-0428227fb03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367e335c-287e-4685-b235-0428227fb03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fee0fa-4d8c-41e4-876d-8e4c384c73d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:17 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Volume 88aaf3c0-4239-4365-8003-e51b2780cf60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88aaf3c0-4239-4365-8003-e51b2780cf60', 'volume_size': 1, 'snapshot_id': '998de0e3-1f6f-4116-a5b4-264b48baba5a'} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:17 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8 Apr 24 19:21:17 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:18 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8" returned: 0 in 0.421s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.407s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-998de0e3-1f6f-4116-a5b4-264b48baba5a-88aaf3c0-4239-4365-8003-e51b2780cf60" by "_create_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a627a53-9cb3-4f85-b60c-405ddba2b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251ddf5a-5335-410b-9999-e72cfe7499c8', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dc23bf-8511-4ae5-890c-154248db02bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-998de0e3-1f6f-4116-a5b4-264b48baba5a-88aaf3c0-4239-4365-8003-e51b2780cf60" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Creating volume 88aaf3c0-4239-4365-8003-e51b2780cf60 from snapshot 998de0e3-1f6f-4116-a5b4-264b48baba5a {{(pid=81522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-88aaf3c0-4239-4365-8003-e51b2780cf60" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:18 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Volume volume-251ddf5a-5335-410b-9999-e72cfe7499c8 (251ddf5a-5335-410b-9999-e72cfe7499c8): created successfully Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dc23bf-8511-4ae5-890c-154248db02bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (df73b0ba-c949-44d8-ad82-b9de41cdfe61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-88aaf3c0-4239-4365-8003-e51b2780cf60" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] snapshot: 998de0e3-1f6f-4116-a5b4-264b48baba5a, volume: 88aaf3c0-4239-4365-8003-e51b2780cf60, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:21:18 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f30e6a41-09a1-4d00-a949-b27f459637fd tempest-VolumesActionsTest-202530879 None] Created volume successfully. Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[56efb509-61f0-4b2b-b680-b1ee35a11367]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:18 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a Apr 24 19:21:18 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Acquiring lock "cinder-251ddf5a-5335-410b-9999-e72cfe7499c8-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Lock "cinder-251ddf5a-5335-410b-9999-e72cfe7499c8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Acquiring lock "cinder-quobyte-251ddf5a-5335-410b-9999-e72cfe7499c8" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Lock "cinder-quobyte-251ddf5a-5335-410b-9999-e72cfe7499c8" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7770805c-d19a-4ed4-b8c6-1e88f6adf747]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:18 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a" returned: 0 in 0.622s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50258f6-52aa-450e-9c0d-3e86f8f5e331]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:18 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8 Apr 24 19:21:18 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:19 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 Apr 24 19:21:19 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:19 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8" returned: 0 in 0.605s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:19 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8 Apr 24 19:21:19 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:19 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" returned: 0 in 0.568s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:19 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:21:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:19 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 Apr 24 19:21:19 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:19 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-251ddf5a-5335-410b-9999-e72cfe7499c8" returned: 0 in 0.499s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Lock "cinder-quobyte-251ddf5a-5335-410b-9999-e72cfe7499c8" released by "delete_volume" :: held 1.156s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:20 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Created reservations ['8f3bb441-7c45-4dec-a40e-c4e348a2538c', '28c106a2-601c-4ea7-998a-f4b30360cd78', '2ac0ed70-2363-4fc5-b8c5-9a76991566c9', '8e9a8070-ac00-4237-8bc8-c8f2642e498c'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:20 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:20 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:20 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:20 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:21 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:21 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:21 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.321s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:21 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Deleted volume successfully. Apr 24 19:21:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d2edb9c8-42ce-463f-aed6-14b59e93e94b tempest-VolumesActionsTest-1730534465 None] Lock "cinder-251ddf5a-5335-410b-9999-e72cfe7499c8-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (09518a38-6af8-4f44-83c1-c6e72b01d437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d06f36-ecd5-4685-8d55-7f2747a32614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d06f36-ecd5-4685-8d55-7f2747a32614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-842331488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130c00f4-ce77-4f57-a444-2ef5c4ee004e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:22Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e310f7-bae5-4ff0-aec2-6de199371963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e310f7-bae5-4ff0-aec2-6de199371963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180a0956-ed44-454c-a128-c22e554d34aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180a0956-ed44-454c-a128-c22e554d34aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130c00f4-ce77-4f57-a444-2ef5c4ee004e', 'volume_name': 'volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7fe72f-7004-4f12-aaf2-058da7d62a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7fe72f-7004-4f12-aaf2-058da7d62a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074c9443-3cf0-4a3b-a1fa-d0bb2f5d3b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:22 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Volume 130c00f4-ce77-4f57-a444-2ef5c4ee004e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e', 'volume_size': 1} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:22 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.415s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:24 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60" returned: 0 in 5.421s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:24 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe144ad-1a1b-4aac-bf7a-d31023778570]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:25 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 Apr 24 19:21:25 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:25 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" returned: 0 in 0.658s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:25 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:21:25 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Converted 1024.00 MB image at 188.88 MB/s Apr 24 19:21:25 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 is being set with open permissions: ugo+rw Apr 24 19:21:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:25 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 Apr 24 19:21:25 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:26 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60" returned: 0 in 0.409s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-88aaf3c0-4239-4365-8003-e51b2780cf60" released by "_copy_volume_from_snapshot" :: held 7.778s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-998de0e3-1f6f-4116-a5b4-264b48baba5a-88aaf3c0-4239-4365-8003-e51b2780cf60" released by "_create_volume_from_snapshot" :: held 7.826s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.855s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.500s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-842331488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130c00f4-ce77-4f57-a444-2ef5c4ee004e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:22Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Creating volume 130c00f4-ce77-4f57-a444-2ef5c4ee004e {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:26 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:26 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e 1073741824 Apr 24 19:21:26 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fee0fa-4d8c-41e4-876d-8e4c384c73d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88aaf3c0-4239-4365-8003-e51b2780cf60', 'volume_size': 1, 'snapshot_id': '998de0e3-1f6f-4116-a5b4-264b48baba5a'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d146e3-0a11-4a07-a6fe-fad8fb8de675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:26 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Volume volume-88aaf3c0-4239-4365-8003-e51b2780cf60 (88aaf3c0-4239-4365-8003-e51b2780cf60): created successfully Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d146e3-0a11-4a07-a6fe-fad8fb8de675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Flow 'volume_create_manager' (089af016-9436-43c6-85a1-a06a54b59eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:26 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a1e28ca8-f37a-4daa-89d6-119b5c8a2196 tempest-VolumesDeleteCascade-840726671 None] Created volume successfully. Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Performing cascade delete. {{(pid=81522) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-998de0e3-1f6f-4116-a5b4-264b48baba5a-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-998de0e3-1f6f-4116-a5b4-264b48baba5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-998de0e3-1f6f-4116-a5b4-264b48baba5a" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-998de0e3-1f6f-4116-a5b4-264b48baba5a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Deleting offline snapshot 998de0e3-1f6f-4116-a5b4-264b48baba5a of volume d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] snapshot_file for this snap is: volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1731d286-ac4f-4d32-a026-a4cfd4bf14aa]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:26 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e 1073741824" returned: 0 in 0.724s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:26 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a Apr 24 19:21:26 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:26 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e Apr 24 19:21:26 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:27 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e" returned: 0 in 0.475s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:27 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a" returned: 0 in 0.574s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074c9443-3cf0-4a3b-a1fa-d0bb2f5d3b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20233df-ccf8-45cd-ba94-fa4c2bbecebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccb8638-1b09-4b7f-8590-1160d0f228c8]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:27 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Volume volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e (130c00f4-ce77-4f57-a444-2ef5c4ee004e): created successfully Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20233df-ccf8-45cd-ba94-fa4c2bbecebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (09518a38-6af8-4f44-83c1-c6e72b01d437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:27 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-81055816-aa94-46dc-81ad-7845fd61284d tempest-VolumesActionsTest-202530879 None] Created volume successfully. Apr 24 19:21:27 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 Apr 24 19:21:27 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:27 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" returned: 0 in 0.522s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:27 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a Apr 24 19:21:27 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Acquiring lock "cinder-130c00f4-ce77-4f57-a444-2ef5c4ee004e-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Lock "cinder-130c00f4-ce77-4f57-a444-2ef5c4ee004e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Acquiring lock "cinder-quobyte-130c00f4-ce77-4f57-a444-2ef5c4ee004e" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Lock "cinder-quobyte-130c00f4-ce77-4f57-a444-2ef5c4ee004e" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ba11bd-10f2-444a-811a-b110ec7b786e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:28 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e Apr 24 19:21:28 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:28 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a" returned: 0 in 0.576s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:28 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a Apr 24 19:21:28 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:28 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e" returned: 0 in 0.557s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:28 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e Apr 24 19:21:28 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:28 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4.998de0e3-1f6f-4116-a5b4-264b48baba5a" returned: 0 in 0.488s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-998de0e3-1f6f-4116-a5b4-264b48baba5a" released by "_delete_snapshot" :: held 2.259s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" released by "delete_snapshot" :: held 2.287s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:28 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:UPDATE=96,cinder:DELETE=9,cinder:SELECT=86,cinder:INSERT=34 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Created reservations ['58ffc916-6143-4e2d-a623-7b45df15fe4b', 'bce93d61-474b-41d9-bd10-84fa99d5b275', '953639e7-13db-4814-a9a1-9dfb3efb0f5e', '34f1d69e-282c-4a48-b495-f16deb346615'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Delete snapshot completed successfully. Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-998de0e3-1f6f-4116-a5b4-264b48baba5a-delete_snapshot" released by "delete_snapshot" :: held 2.463s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Snapshots deleted, issuing volume delete {{(pid=81522) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" acquired by "delete_volume" :: waited 0.013s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:29 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3300b1-e946-4d6f-8432-86f5a81a2419]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-130c00f4-ce77-4f57-a444-2ef5c4ee004e" returned: 0 in 0.543s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Lock "cinder-quobyte-130c00f4-ce77-4f57-a444-2ef5c4ee004e" released by "delete_volume" :: held 1.140s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Created reservations ['873177e2-eb2c-4c03-9915-039fa769246c', '3bf2d750-b4f0-4144-afe8-0fee31925314', '283d100f-5de3-409b-9b56-1571187f3088', 'dfd2bb79-7934-457b-89a6-a43ec994a231'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:29 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 Apr 24 19:21:29 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:29 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:29 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:29 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" returned: 0 in 0.561s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:29 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4 Apr 24 19:21:29 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:29 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.525s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Deleted volume successfully. Apr 24 19:21:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4b551110-5f39-4401-b443-889ee4b51d1b tempest-VolumesActionsTest-1730534465 None] Lock "cinder-130c00f4-ce77-4f57-a444-2ef5c4ee004e-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:30 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" returned: 0 in 0.460s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4" released by "delete_volume" :: held 1.095s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Created reservations ['fd466c63-dc96-4b9e-bb76-c10683e873f3', 'dfde3401-e318-4705-ba18-cb5fb3432a68', 'b953e070-5b07-4f7d-83c5-fd9cfa48f524', 'eab16eee-d5df-4c14-a978-f7fe6161e595'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:30 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:30 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (895c5f17-ce86-43ab-9456-f6c716c82699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7e6ca9-2a79-4d8f-baab-93ef010e4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7e6ca9-2a79-4d8f-baab-93ef010e4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1069437091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2880bd1b-75ae-42e8-9e90-d1135df04172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:31Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbcfd94-56a0-4898-a8bb-f938886eefdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbcfd94-56a0-4898-a8bb-f938886eefdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6625b8b1-1498-4d28-a1d8-d1ebbfaa3317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6625b8b1-1498-4d28-a1d8-d1ebbfaa3317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2880bd1b-75ae-42e8-9e90-d1135df04172', 'volume_name': 'volume-2880bd1b-75ae-42e8-9e90-d1135df04172', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c999f40-9480-4bf3-902b-7ea31487a02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c999f40-9480-4bf3-902b-7ea31487a02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2740df1-ddc3-42f7-a96e-10a37cdc94aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Volume 2880bd1b-75ae-42e8-9e90-d1135df04172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2880bd1b-75ae-42e8-9e90-d1135df04172', 'volume_size': 1} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1069437091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2880bd1b-75ae-42e8-9e90-d1135df04172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6346da9b0004bb8a6989eda6ea3ccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:31Z,use_quota=True,user_id='69fe5aa969144e499399e659d6d65bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Creating volume 2880bd1b-75ae-42e8-9e90-d1135df04172 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:30 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:30 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172 1073741824 Apr 24 19:21:30 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:30 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.477s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:30 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Deleted volume successfully. Apr 24 19:21:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-67c80e66-ed0c-4a29-9fd6-2492a1882904 tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-d8baa5c6-45f1-47c1-b34c-9122a3bb8dc4-delete_volume" released by "delete_volume" :: held 4.275s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-88aaf3c0-4239-4365-8003-e51b2780cf60-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-88aaf3c0-4239-4365-8003-e51b2780cf60-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "cinder-quobyte-88aaf3c0-4239-4365-8003-e51b2780cf60" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-88aaf3c0-4239-4365-8003-e51b2780cf60" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6dbdb1-db6b-409d-a471-6fc58bbf9d1d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:31 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 Apr 24 19:21:31 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:31 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172 1073741824" returned: 0 in 0.679s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:31 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172 Apr 24 19:21:31 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:31 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60" returned: 0 in 0.596s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:31 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60 Apr 24 19:21:31 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:31 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172" returned: 0 in 0.467s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2740df1-ddc3-42f7-a96e-10a37cdc94aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2880bd1b-75ae-42e8-9e90-d1135df04172', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69269e21-1dd0-4aa2-a687-797aa085dd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:31 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Volume volume-2880bd1b-75ae-42e8-9e90-d1135df04172 (2880bd1b-75ae-42e8-9e90-d1135df04172): created successfully Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69269e21-1dd0-4aa2-a687-797aa085dd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:31 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Flow 'volume_create_manager' (895c5f17-ce86-43ab-9456-f6c716c82699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:31 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6cb15713-619e-4b32-91f1-f3ca821a995f tempest-VolumesActionsTest-202530879 None] Created volume successfully. Apr 24 19:21:32 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-88aaf3c0-4239-4365-8003-e51b2780cf60" returned: 0 in 0.491s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-quobyte-88aaf3c0-4239-4365-8003-e51b2780cf60" released by "delete_volume" :: held 1.128s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Created reservations ['73c198bf-4c0b-423d-b129-7830c804a52a', '26e45208-52f4-4071-a54e-6611a9e14c51', 'e7af5baf-9d49-40cb-8071-0c8478872ef9', '02a52a22-4f68-4817-b258-e5f48a7f4a13'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:32 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:32 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:32 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.441s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:32 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Deleted volume successfully. Apr 24 19:21:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ad63f410-235e-4cf0-bf7b-0dc9457b43ca tempest-VolumesDeleteCascade-840726671 None] Lock "cinder-88aaf3c0-4239-4365-8003-e51b2780cf60-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Acquiring lock "cinder-2880bd1b-75ae-42e8-9e90-d1135df04172-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Lock "cinder-2880bd1b-75ae-42e8-9e90-d1135df04172-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Acquiring lock "cinder-quobyte-2880bd1b-75ae-42e8-9e90-d1135df04172" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Lock "cinder-quobyte-2880bd1b-75ae-42e8-9e90-d1135df04172" acquired by "delete_volume" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:33 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[860db458-8019-4210-9f21-b2fbedb997f6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:33 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172 Apr 24 19:21:33 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:34 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172" returned: 0 in 0.645s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:34 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172 Apr 24 19:21:34 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:34 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2880bd1b-75ae-42e8-9e90-d1135df04172" returned: 0 in 0.555s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Lock "cinder-quobyte-2880bd1b-75ae-42e8-9e90-d1135df04172" released by "delete_volume" :: held 1.254s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Created reservations ['085895b9-dc57-43d3-aa37-36d5f0ab69fa', '90302aa2-9e2f-43d2-88a8-fcad995f545f', '653a6609-d626-407e-bce1-beb9d89d5731', '182ccc1b-c87b-4436-bd09-bbc3cef69753'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:34 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:34 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:35 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.538s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:35 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:35 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Deleted volume successfully. Apr 24 19:21:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-90f0a997-277d-4886-9719-9bf3f36dd536 tempest-VolumesActionsTest-202530879 None] Lock "cinder-2880bd1b-75ae-42e8-9e90-d1135df04172-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Flow 'volume_create_manager' (c9fd0b36-b4f0-4e84-bf01-c9b334a963f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9afef4-e95b-4a2c-9971-a08cfd61ac7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9afef4-e95b-4a2c-9971-a08cfd61ac7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-876213951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c4ec40-7879-4f65-ada1-d13ac672ef85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7fb7aac74e49f9808efebf8238467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:38Z,use_quota=True,user_id='9972c4a4f4974f03a99c656ba19e98db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241b68ec-bd32-4ad8-8f46-4d8653611e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241b68ec-bd32-4ad8-8f46-4d8653611e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad14f597-f107-45d6-8c6f-43e19b0f2054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad14f597-f107-45d6-8c6f-43e19b0f2054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c4ec40-7879-4f65-ada1-d13ac672ef85', 'volume_name': 'volume-12c4ec40-7879-4f65-ada1-d13ac672ef85', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db23bf6b-0633-417e-8bce-353ef99ca5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db23bf6b-0633-417e-8bce-353ef99ca5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b9b97d-37a6-4894-9f18-16e1157040b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:37 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Volume 12c4ec40-7879-4f65-ada1-d13ac672ef85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c4ec40-7879-4f65-ada1-d13ac672ef85', 'volume_size': 1} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-876213951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c4ec40-7879-4f65-ada1-d13ac672ef85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7fb7aac74e49f9808efebf8238467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:38Z,use_quota=True,user_id='9972c4a4f4974f03a99c656ba19e98db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Creating volume 12c4ec40-7879-4f65-ada1-d13ac672ef85 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:37 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:21:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:37 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 1073741824 Apr 24 19:21:37 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:38 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 1073741824" returned: 0 in 0.745s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:38 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 Apr 24 19:21:38 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:39 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85" returned: 0 in 0.521s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:39 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=117,cinder:UPDATE=143,cinder:INSERT=30,cinder:DELETE=13 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:21:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b9b97d-37a6-4894-9f18-16e1157040b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c4ec40-7879-4f65-ada1-d13ac672ef85', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9a748d-d880-49d1-a87f-d3334631a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:39 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Volume volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 (12c4ec40-7879-4f65-ada1-d13ac672ef85): created successfully Apr 24 19:21:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9a748d-d880-49d1-a87f-d3334631a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Flow 'volume_create_manager' (c9fd0b36-b4f0-4e84-bf01-c9b334a963f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:39 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-901cf756-1159-4a04-8942-388583156745 tempest-VolumesTransfersTest-1766728167 None] Created volume successfully. Apr 24 19:21:40 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c7d963cf-f692-4919-833e-a9c5f5d21888 tempest-VolumesTransfersTest-1383504963 None] Transfer volume completed successfully. Apr 24 19:21:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Acquiring lock "cinder-12c4ec40-7879-4f65-ada1-d13ac672ef85-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Lock "cinder-12c4ec40-7879-4f65-ada1-d13ac672ef85-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Acquiring lock "cinder-quobyte-12c4ec40-7879-4f65-ada1-d13ac672ef85" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Lock "cinder-quobyte-12c4ec40-7879-4f65-ada1-d13ac672ef85" acquired by "delete_volume" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:41 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d29685-2e56-4d0a-8e67-40211ca718dd]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:41 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 Apr 24 19:21:41 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:42 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85" returned: 0 in 0.741s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:42 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85 Apr 24 19:21:42 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:43 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-12c4ec40-7879-4f65-ada1-d13ac672ef85" returned: 0 in 0.528s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Lock "cinder-quobyte-12c4ec40-7879-4f65-ada1-d13ac672ef85" released by "delete_volume" :: held 1.321s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Created reservations ['2169eb8b-4430-43d5-a6bb-4e7458b37549', 'c89f9d0a-4409-4731-baed-db5b1cc254c0', '48a9716d-14bb-47b4-a38f-983ef8ccb15a', 'c79810e9-8515-4797-b3dc-955f2caffe86'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:43 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:43 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:43 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.556s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Deleted volume successfully. Apr 24 19:21:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78bb0bd4-7362-4489-ac64-aee53b5985b4 tempest-VolumesTransfersTest-1995080084 None] Lock "cinder-12c4ec40-7879-4f65-ada1-d13ac672ef85-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Flow 'volume_create_manager' (55f5cf3d-f064-4606-b93f-6d5dc1aa816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06879b13-b3c9-491e-9f3d-a07fa584d9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06879b13-b3c9-491e-9f3d-a07fa584d9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-475605663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c028363-36db-4cac-a414-59f0c6ee9b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7fb7aac74e49f9808efebf8238467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:44Z,use_quota=True,user_id='9972c4a4f4974f03a99c656ba19e98db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059c6e53-470c-4a2e-832e-3611f441881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059c6e53-470c-4a2e-832e-3611f441881e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992b86fd-58d9-4358-9fa8-ccb9eda75928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992b86fd-58d9-4358-9fa8-ccb9eda75928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c028363-36db-4cac-a414-59f0c6ee9b5b', 'volume_name': 'volume-9c028363-36db-4cac-a414-59f0c6ee9b5b', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b53707-243d-4806-9f28-bdb7db469b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b53707-243d-4806-9f28-bdb7db469b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72a5cb5-7977-4645-a6a9-4bd73805f9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:44 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Volume 9c028363-36db-4cac-a414-59f0c6ee9b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c028363-36db-4cac-a414-59f0c6ee9b5b', 'volume_size': 1} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-475605663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c028363-36db-4cac-a414-59f0c6ee9b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7fb7aac74e49f9808efebf8238467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:44Z,use_quota=True,user_id='9972c4a4f4974f03a99c656ba19e98db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Creating volume 9c028363-36db-4cac-a414-59f0c6ee9b5b {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:44 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:21:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:44 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b 1073741824 Apr 24 19:21:44 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:45 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b 1073741824" returned: 0 in 0.757s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:45 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b Apr 24 19:21:45 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:45 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b" returned: 0 in 0.486s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72a5cb5-7977-4645-a6a9-4bd73805f9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c028363-36db-4cac-a414-59f0c6ee9b5b', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bebaf4-ad95-47a2-8ef5-e3b32ad83db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:45 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Volume volume-9c028363-36db-4cac-a414-59f0c6ee9b5b (9c028363-36db-4cac-a414-59f0c6ee9b5b): created successfully Apr 24 19:21:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bebaf4-ad95-47a2-8ef5-e3b32ad83db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Flow 'volume_create_manager' (55f5cf3d-f064-4606-b93f-6d5dc1aa816d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:45 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d7e44899-0c52-40ff-9a43-2ad8c17b6c01 tempest-VolumesTransfersTest-1766728167 None] Created volume successfully. Apr 24 19:21:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Acquiring lock "cinder-9c028363-36db-4cac-a414-59f0c6ee9b5b-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Lock "cinder-9c028363-36db-4cac-a414-59f0c6ee9b5b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Acquiring lock "cinder-quobyte-9c028363-36db-4cac-a414-59f0c6ee9b5b" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Lock "cinder-quobyte-9c028363-36db-4cac-a414-59f0c6ee9b5b" acquired by "delete_volume" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:47 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cc44ae-cbe0-4650-831a-ac0fab582dac]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:47 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b Apr 24 19:21:47 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:47 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b" returned: 0 in 0.599s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:47 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b Apr 24 19:21:47 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:48 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9c028363-36db-4cac-a414-59f0c6ee9b5b" returned: 0 in 0.496s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Lock "cinder-quobyte-9c028363-36db-4cac-a414-59f0c6ee9b5b" released by "delete_volume" :: held 1.162s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Created reservations ['0857b15b-e781-43c9-82f2-04c205cd63cf', 'bd0d26a0-f5fe-4935-9fb0-13012bd898ab', '83675d65-5df9-4cfc-9923-4d01891920d4', '61f53e94-eb84-4735-be4f-b701a8953b31'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:48 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:21:48 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:48 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.503s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:48 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Deleted volume successfully. Apr 24 19:21:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-abbda8c5-bac7-469e-b186-1f51559b2a23 tempest-VolumesTransfersTest-1995080084 None] Lock "cinder-9c028363-36db-4cac-a414-59f0c6ee9b5b-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Flow 'volume_create_manager' (162e82b3-b515-4a71-9f63-37f742126eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236632a3-5383-47ee-9f2b-22a03a1fff1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236632a3-5383-47ee-9f2b-22a03a1fff1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-233842923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfec798-dea0-4a2b-b52d-8752126d4468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18547331a7bf4bf197bdcff6fdb66330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:50Z,use_quota=True,user_id='49edef04cafc481f9e50bf3dc294feb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f57ccd-7744-4397-8803-cebae4dc6693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f57ccd-7744-4397-8803-cebae4dc6693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc75713a-e4dd-405b-9959-1673b3e50efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc75713a-e4dd-405b-9959-1673b3e50efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfec798-dea0-4a2b-b52d-8752126d4468', 'volume_name': 'volume-2cfec798-dea0-4a2b-b52d-8752126d4468', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a39b85-924f-4264-864c-0062da1d144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a39b85-924f-4264-864c-0062da1d144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f95a638-52dc-45fb-bb84-e8a9421a8073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:49 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Volume 2cfec798-dea0-4a2b-b52d-8752126d4468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfec798-dea0-4a2b-b52d-8752126d4468', 'volume_size': 1} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-233842923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfec798-dea0-4a2b-b52d-8752126d4468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18547331a7bf4bf197bdcff6fdb66330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:50Z,use_quota=True,user_id='49edef04cafc481f9e50bf3dc294feb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Creating volume 2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:49 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:21:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:49 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 1073741824 Apr 24 19:21:49 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:50 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 1073741824" returned: 0 in 0.745s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:50 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 Apr 24 19:21:50 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:51 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468" returned: 0 in 0.572s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f95a638-52dc-45fb-bb84-e8a9421a8073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfec798-dea0-4a2b-b52d-8752126d4468', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a042d2df-8b5a-4411-8704-dc6d3d70ff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:51 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Volume volume-2cfec798-dea0-4a2b-b52d-8752126d4468 (2cfec798-dea0-4a2b-b52d-8752126d4468): created successfully Apr 24 19:21:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a042d2df-8b5a-4411-8704-dc6d3d70ff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Flow 'volume_create_manager' (162e82b3-b515-4a71-9f63-37f742126eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:51 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-97778d0c-93e0-4102-9deb-eb114b843fc5 tempest-VolumesCloneTest-813110738 None] Created volume successfully. Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Flow 'volume_create_manager' (a86b4718-cf16-498c-9087-8c56604f17b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7703cdca-2a06-4029-8c87-12ad37a57500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7703cdca-2a06-4029-8c87-12ad37a57500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-669139703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b631b36-fbcd-4183-ac5b-add1672c52ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18547331a7bf4bf197bdcff6fdb66330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2cfec798-dea0-4a2b-b52d-8752126d4468,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:52Z,use_quota=True,user_id='49edef04cafc481f9e50bf3dc294feb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0830c624-f249-4dff-a77e-828968970bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0830c624-f249-4dff-a77e-828968970bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9770c4-b5b8-4a61-8576-871df26976ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9770c4-b5b8-4a61-8576-871df26976ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7b631b36-fbcd-4183-ac5b-add1672c52ff', 'volume_name': 'volume-7b631b36-fbcd-4183-ac5b-add1672c52ff', 'volume_size': 2, 'source_volid': '2cfec798-dea0-4a2b-b52d-8752126d4468', 'source_volstatus': 'available'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480ec417-538e-46bf-9151-f60756d60a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480ec417-538e-46bf-9151-f60756d60a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a287f5-c0b5-44a5-8427-8f5951bb60a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:52 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Volume 7b631b36-fbcd-4183-ac5b-add1672c52ff: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7b631b36-fbcd-4183-ac5b-add1672c52ff', 'volume_size': 2, 'source_volid': '2cfec798-dea0-4a2b-b52d-8752126d4468', 'source_volstatus': 'available'} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:52 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Cloning volume 2cfec798-dea0-4a2b-b52d-8752126d4468 to volume 7b631b36-fbcd-4183-ac5b-add1672c52ff Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Creating offline snapshot aeee478f-ab74-433e-bbcb-f82a6c152429 of volume 2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ec266a-7f86-455f-ac46-c69d97607b46]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:52 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 Apr 24 19:21:52 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:53 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468" returned: 0 in 0.694s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:53 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 1G Apr 24 19:21:53 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:54 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 1G" returned: 0 in 0.791s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cfec798-dea0-4a2b-b52d-8752126d4468 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:54 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cfec798-dea0-4a2b-b52d-8752126d4468 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 Apr 24 19:21:54 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:54 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cfec798-dea0-4a2b-b52d-8752126d4468 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429" returned: 0 in 0.712s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:54 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 is being set with open permissions: ugo+rw Apr 24 19:21:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:54 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 Apr 24 19:21:54 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:55 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429" returned: 0 in 0.511s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:55 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.info Apr 24 19:21:55 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:55 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.info" returned: 0 in 0.543s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:55 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.info is being set with open permissions: ugo+rw Apr 24 19:21:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:55 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.info Apr 24 19:21:55 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:56 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.info" returned: 0 in 0.480s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Acquiring lock "cinder-quobyte-7b631b36-fbcd-4183-ac5b-add1672c52ff" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Lock "cinder-quobyte-7b631b36-fbcd-4183-ac5b-add1672c52ff" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] snapshot: aeee478f-ab74-433e-bbcb-f82a6c152429, volume: 7b631b36-fbcd-4183-ac5b-add1672c52ff, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c9fd11-c86e-4b74-9ab8-268670939f8c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:56 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 Apr 24 19:21:56 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:57 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429" returned: 0 in 0.611s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cfec798-dea0-4a2b-b52d-8752126d4468(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:21:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:21:57 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e1b5a0-4ffe-4e9d-95c4-940be87185be]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:57 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 Apr 24 19:21:57 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:57 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468" returned: 0 in 0.607s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:57 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:21:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:57 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff Apr 24 19:21:57 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:03 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff" returned: 0 in 5.533s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e96cfc-f1a1-4b03-81f9-27f4f3ce4d20]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:03 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 Apr 24 19:22:03 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:04 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468" returned: 0 in 0.926s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:22:04 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Converted 1024.00 MB image at 184.99 MB/s Apr 24 19:22:04 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff is being set with open permissions: ugo+rw Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:04 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff Apr 24 19:22:04 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:04 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff" returned: 0 in 0.526s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Lock "cinder-quobyte-7b631b36-fbcd-4183-ac5b-add1672c52ff" released by "_copy_volume_from_snapshot" :: held 8.297s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Acquiring lock "cinder-quobyte-aeee478f-ab74-433e-bbcb-f82a6c152429" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Lock "cinder-quobyte-aeee478f-ab74-433e-bbcb-f82a6c152429" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Deleting offline snapshot aeee478f-ab74-433e-bbcb-f82a6c152429 of volume 2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] snapshot_file for this snap is: volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5712657-17d4-4a89-aa0c-59c4ef214d4d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:04 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 Apr 24 19:22:04 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:05 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429" returned: 0 in 0.603s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cfec798-dea0-4a2b-b52d-8752126d4468(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:05 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca204b2-62ed-4711-9f09-4d641059d67a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:05 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 Apr 24 19:22:05 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:06 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468" returned: 0 in 0.579s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:06 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 Apr 24 19:22:06 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:06 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429" returned: 0 in 0.640s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:06 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429 Apr 24 19:22:06 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:07 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468.aeee478f-ab74-433e-bbcb-f82a6c152429" returned: 0 in 0.604s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Lock "cinder-quobyte-aeee478f-ab74-433e-bbcb-f82a6c152429" released by "_delete_snapshot" :: held 2.529s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.769s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a287f5-c0b5-44a5-8427-8f5951bb60a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b631b36-fbcd-4183-ac5b-add1672c52ff', 'volume_size': 2, 'source_volid': '2cfec798-dea0-4a2b-b52d-8752126d4468', 'source_volstatus': 'available'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d722eeb-fcb0-48f0-90bf-a523ee9c7315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:07 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Volume volume-7b631b36-fbcd-4183-ac5b-add1672c52ff (7b631b36-fbcd-4183-ac5b-add1672c52ff): created successfully Apr 24 19:22:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d722eeb-fcb0-48f0-90bf-a523ee9c7315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Flow 'volume_create_manager' (a86b4718-cf16-498c-9087-8c56604f17b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:07 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-08a0fd8e-0e89-46fd-84ee-7cc7ad29fbe2 tempest-VolumesCloneTest-813110738 None] Created volume successfully. Apr 24 19:22:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Acquiring lock "cinder-7b631b36-fbcd-4183-ac5b-add1672c52ff-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Lock "cinder-7b631b36-fbcd-4183-ac5b-add1672c52ff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Acquiring lock "cinder-quobyte-7b631b36-fbcd-4183-ac5b-add1672c52ff" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Lock "cinder-quobyte-7b631b36-fbcd-4183-ac5b-add1672c52ff" acquired by "delete_volume" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[158dd976-8934-497a-ae64-0389fde7e880]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Flow 'volume_create_manager' (7cc13d5d-90e6-4e53-bd3b-e1fe58084c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4b7295-36fd-43a2-ad5d-13ce261bcc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:08 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff Apr 24 19:22:08 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4b7295-36fd-43a2-ad5d-13ce261bcc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506125895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c9b4bc-1220-4699-9626-659ba35e0370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6526692bc342018b0e7f1d35bf1739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:08Z,use_quota=True,user_id='0a67d8db90c9403bbb3ed851f6989262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e753bc2-2d5b-4165-9a87-4b6e22bf39d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e753bc2-2d5b-4165-9a87-4b6e22bf39d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34952392-d477-4adb-9dfb-0d477b0bec49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34952392-d477-4adb-9dfb-0d477b0bec49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c9b4bc-1220-4699-9626-659ba35e0370', 'volume_name': 'volume-a7c9b4bc-1220-4699-9626-659ba35e0370', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9755f39-3beb-43ba-8fd7-da8aa8a03552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9755f39-3beb-43ba-8fd7-da8aa8a03552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258c376f-6593-4bb9-befb-d3999c3a1384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:08 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Volume a7c9b4bc-1220-4699-9626-659ba35e0370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c9b4bc-1220-4699-9626-659ba35e0370', 'volume_size': 1} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506125895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c9b4bc-1220-4699-9626-659ba35e0370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6526692bc342018b0e7f1d35bf1739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:08Z,use_quota=True,user_id='0a67d8db90c9403bbb3ed851f6989262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Creating volume a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:08 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:08 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 1073741824 Apr 24 19:22:08 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:08 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff" returned: 0 in 0.576s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:08 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff Apr 24 19:22:08 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:09 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 1073741824" returned: 0 in 0.773s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:09 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 Apr 24 19:22:09 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:09 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7b631b36-fbcd-4183-ac5b-add1672c52ff" returned: 0 in 0.530s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Lock "cinder-quobyte-7b631b36-fbcd-4183-ac5b-add1672c52ff" released by "delete_volume" :: held 1.170s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Created reservations ['ed128801-2de6-42c8-a0ae-b3ba5a569f89', 'a74331ac-59e8-4e61-b117-cda6a9e7b68c', '453d265e-fdd5-4ae0-ae2f-9012af468d7f', 'b194049a-0a3b-4a04-b48f-794f65d592fc'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:09 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:22:09 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:09 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370" returned: 0 in 0.510s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258c376f-6593-4bb9-befb-d3999c3a1384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c9b4bc-1220-4699-9626-659ba35e0370', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6503d3a1-4eae-4c17-b3db-b5dfe4e92c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:09 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Volume volume-a7c9b4bc-1220-4699-9626-659ba35e0370 (a7c9b4bc-1220-4699-9626-659ba35e0370): created successfully Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6503d3a1-4eae-4c17-b3db-b5dfe4e92c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Flow 'volume_create_manager' (7cc13d5d-90e6-4e53-bd3b-e1fe58084c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:09 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-95236a78-036f-4adb-a600-f945579d5d11 tempest-VolumesActionsTest-434246189 None] Created volume successfully. Apr 24 19:22:09 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.445s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:09 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Deleted volume successfully. Apr 24 19:22:09 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a89960ab-77d1-4e68-8791-54d6c2b3abd9 tempest-VolumesCloneTest-813110738 None] Lock "cinder-7b631b36-fbcd-4183-ac5b-add1672c52ff-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Acquiring lock "cinder-2cfec798-dea0-4a2b-b52d-8752126d4468-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Lock "cinder-2cfec798-dea0-4a2b-b52d-8752126d4468-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Acquiring lock "cinder-quobyte-2cfec798-dea0-4a2b-b52d-8752126d4468" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Lock "cinder-quobyte-2cfec798-dea0-4a2b-b52d-8752126d4468" acquired by "delete_volume" :: waited 0.027s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:10 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddf1010-a5e6-462e-9000-31d209340c41]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:10 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 Apr 24 19:22:10 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:11 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468" returned: 0 in 0.583s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:11 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468 Apr 24 19:22:11 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:11 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2cfec798-dea0-4a2b-b52d-8752126d4468" returned: 0 in 0.468s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Lock "cinder-quobyte-2cfec798-dea0-4a2b-b52d-8752126d4468" released by "delete_volume" :: held 1.113s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Created reservations ['0ee678d3-e622-43ab-8546-6add2af1ea6a', '9f9e4d2e-af76-4a5c-a044-911da32a22f2', '09668a92-41d0-4ce1-8d55-30e48ff700b8', 'fc7e32c4-22e4-421b-8a60-23ce53b9f188'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:11 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:22:11 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:12 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.439s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:12 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:12 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Deleted volume successfully. Apr 24 19:22:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-2c265677-76f2-4a9e-8b40-00885666ca89 tempest-VolumesCloneTest-813110738 None] Lock "cinder-2cfec798-dea0-4a2b-b52d-8752126d4468-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:22:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:21 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:22:21 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:21 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=57,cinder:INSERT=24,cinder:UPDATE=90,cinder:DELETE=6 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:22:21 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.656s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:22 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=30,cinder:UPDATE=40,cinder:INSERT=13,cinder:DELETE=5 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:22:25 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (7a8f9b8e-4c1d-4d18-b2ea-756abbe5b187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daa4a5a-a27b-4266-80e5-6b821c38899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daa4a5a-a27b-4266-80e5-6b821c38899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-658747917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8220a8ac-1525-4049-8982-90dcf54fa241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88fdf07f7b044adbefcf171b168b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:26Z,use_quota=True,user_id='c906f274a8224f8dbfe8edcee3e1be8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13119dfe-a43d-408a-8276-4a6438284a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13119dfe-a43d-408a-8276-4a6438284a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c98bd4d-0075-414b-b58e-7b1df1f721f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c98bd4d-0075-414b-b58e-7b1df1f721f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8220a8ac-1525-4049-8982-90dcf54fa241', 'volume_name': 'volume-8220a8ac-1525-4049-8982-90dcf54fa241', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ff46b6-a219-46bc-a914-2efa99bc9ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ff46b6-a219-46bc-a914-2efa99bc9ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef0007d-6578-4434-a833-968dff2be559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Volume 8220a8ac-1525-4049-8982-90dcf54fa241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8220a8ac-1525-4049-8982-90dcf54fa241', 'volume_size': 1} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-658747917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8220a8ac-1525-4049-8982-90dcf54fa241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88fdf07f7b044adbefcf171b168b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:26Z,use_quota=True,user_id='c906f274a8224f8dbfe8edcee3e1be8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Creating volume 8220a8ac-1525-4049-8982-90dcf54fa241 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:26 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:26 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 1073741824 Apr 24 19:22:26 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:26 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 1073741824" returned: 0 in 0.905s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:27 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 Apr 24 19:22:27 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:27 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241" returned: 0 in 0.496s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef0007d-6578-4434-a833-968dff2be559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8220a8ac-1525-4049-8982-90dcf54fa241', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47dd79b-d0df-4946-ac44-c246b6d35015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:27 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Volume volume-8220a8ac-1525-4049-8982-90dcf54fa241 (8220a8ac-1525-4049-8982-90dcf54fa241): created successfully Apr 24 19:22:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47dd79b-d0df-4946-ac44-c246b6d35015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (7a8f9b8e-4c1d-4d18-b2ea-756abbe5b187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:27 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f3e0735a-50b9-49ac-923b-6a53c9d57673 tempest-VolumesSnapshotTestJSON-1743295061 None] Created volume successfully. Apr 24 19:22:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Creating offline snapshot d391e972-2c1e-49e1-bfe1-f9c12d649dce of volume 8220a8ac-1525-4049-8982-90dcf54fa241 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:22:28 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7974bf17-d609-4e14-95c1-dae8c0b5429c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:28 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 Apr 24 19:22:28 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:29 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241" returned: 0 in 0.584s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:29 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce 1G Apr 24 19:22:29 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c7370de1-4a27-4eed-beaa-8a1aa3484c59 tempest-VolumesActionsTest-434246189 None] Acquiring lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370" by "attach_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c7370de1-4a27-4eed-beaa-8a1aa3484c59 tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370" acquired by "attach_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c7370de1-4a27-4eed-beaa-8a1aa3484c59 tempest-VolumesActionsTest-434246189 None] Attaching volume a7c9b4bc-1220-4699-9626-659ba35e0370 to instance 8c2ef69f-7b2d-46dd-b3b7-428fd3197d2a at mountpoint /dev/vdb on host None. Apr 24 19:22:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c7370de1-4a27-4eed-beaa-8a1aa3484c59 tempest-VolumesActionsTest-434246189 None] Attach volume completed successfully. Apr 24 19:22:29 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c7370de1-4a27-4eed-beaa-8a1aa3484c59 tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370" released by "attach_volume" :: held 0.117s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:29 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce 1G" returned: 0 in 0.907s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8220a8ac-1525-4049-8982-90dcf54fa241 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:29 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8220a8ac-1525-4049-8982-90dcf54fa241 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce Apr 24 19:22:29 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4aa16959-104e-4be1-9d5f-eee2b0b2516f tempest-VolumesActionsTest-434246189 None] Acquiring lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370-detach_volume" by "detach_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4aa16959-104e-4be1-9d5f-eee2b0b2516f tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:30 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4aa16959-104e-4be1-9d5f-eee2b0b2516f tempest-VolumesActionsTest-434246189 None] Detaching volume a7c9b4bc-1220-4699-9626-659ba35e0370 from instance 8c2ef69f-7b2d-46dd-b3b7-428fd3197d2a. Apr 24 19:22:30 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4aa16959-104e-4be1-9d5f-eee2b0b2516f tempest-VolumesActionsTest-434246189 None] Detach volume completed successfully. Apr 24 19:22:30 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4aa16959-104e-4be1-9d5f-eee2b0b2516f tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:30 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8220a8ac-1525-4049-8982-90dcf54fa241 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce" returned: 0 in 0.514s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:30 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce is being set with open permissions: ugo+rw Apr 24 19:22:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:30 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce Apr 24 19:22:30 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:31 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce" returned: 0 in 0.543s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:31 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.info Apr 24 19:22:31 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:31 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.info" returned: 0 in 0.547s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:31 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.info is being set with open permissions: ugo+rw Apr 24 19:22:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:31 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.info Apr 24 19:22:31 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:32 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.info" returned: 0 in 0.517s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.725s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:32 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-3697029b-ba3e-4b64-b85c-419177437a02 tempest-VolumesSnapshotTestJSON-1743295061 None] Create snapshot completed successfully Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-d391e972-2c1e-49e1-bfe1-f9c12d649dce-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-d391e972-2c1e-49e1-bfe1-f9c12d649dce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-8220a8ac-1525-4049-8982-90dcf54fa241" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-8220a8ac-1525-4049-8982-90dcf54fa241" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-d391e972-2c1e-49e1-bfe1-f9c12d649dce" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-d391e972-2c1e-49e1-bfe1-f9c12d649dce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Deleting offline snapshot d391e972-2c1e-49e1-bfe1-f9c12d649dce of volume 8220a8ac-1525-4049-8982-90dcf54fa241 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] snapshot_file for this snap is: volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[91599cae-e060-46f9-aaf2-a3643ddf03f6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:32 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce Apr 24 19:22:32 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:33 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce" returned: 0 in 0.592s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8220a8ac-1525-4049-8982-90dcf54fa241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:33 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07772d3-27fb-4e61-8acc-afbc9ea8d86a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:33 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 Apr 24 19:22:33 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:34 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241" returned: 0 in 0.576s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:34 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce Apr 24 19:22:34 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:34 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce" returned: 0 in 0.604s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:34 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce Apr 24 19:22:34 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:35 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241.d391e972-2c1e-49e1-bfe1-f9c12d649dce" returned: 0 in 0.461s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-d391e972-2c1e-49e1-bfe1-f9c12d649dce" released by "_delete_snapshot" :: held 2.339s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-8220a8ac-1525-4049-8982-90dcf54fa241" released by "delete_snapshot" :: held 2.363s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:35 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Created reservations ['c223c7b1-7fe4-496d-96d7-aa4ace3b51ff', '1588bfdc-2a0c-435a-bdc3-390fee2187c6', '14bf2855-2c12-4bbf-84d4-c7307df03d0a', '76032430-8edb-4483-8867-ad58d2cfeaf2'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:35 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Delete snapshot completed successfully. Apr 24 19:22:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-78b6443d-9fc3-42db-af61-212c4598ff81 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-d391e972-2c1e-49e1-bfe1-f9c12d649dce-delete_snapshot" released by "delete_snapshot" :: held 2.550s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (6715da1a-61be-426a-ab38-e4e06b542d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18984de8-e3c1-4eb4-bd41-b9aa8cbda8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18984de8-e3c1-4eb4-bd41-b9aa8cbda8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1064997392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090828a5-7ec8-4d86-b721-56e304c61b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88fdf07f7b044adbefcf171b168b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:36Z,use_quota=True,user_id='c906f274a8224f8dbfe8edcee3e1be8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc654fe8-5fc7-45df-aee1-879ad036a93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc654fe8-5fc7-45df-aee1-879ad036a93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be512a9-c14d-4a77-bb9f-69976381052c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be512a9-c14d-4a77-bb9f-69976381052c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090828a5-7ec8-4d86-b721-56e304c61b4a', 'volume_name': 'volume-090828a5-7ec8-4d86-b721-56e304c61b4a', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f40ded-42bd-4582-88f4-ebe99c0be7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f40ded-42bd-4582-88f4-ebe99c0be7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5861bf89-7c72-4967-bd7a-45c2c400cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:36 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Volume 090828a5-7ec8-4d86-b721-56e304c61b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090828a5-7ec8-4d86-b721-56e304c61b4a', 'volume_size': 1} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1064997392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090828a5-7ec8-4d86-b721-56e304c61b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88fdf07f7b044adbefcf171b168b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:36Z,use_quota=True,user_id='c906f274a8224f8dbfe8edcee3e1be8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Creating volume 090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:36 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:22:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:36 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a 1073741824 Apr 24 19:22:36 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:37 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a 1073741824" returned: 0 in 0.608s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:37 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a Apr 24 19:22:37 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:37 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a" returned: 0 in 0.524s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:37 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5861bf89-7c72-4967-bd7a-45c2c400cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090828a5-7ec8-4d86-b721-56e304c61b4a', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e124db-b4ac-47c7-9db4-2eee790a68ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:37 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Volume volume-090828a5-7ec8-4d86-b721-56e304c61b4a (090828a5-7ec8-4d86-b721-56e304c61b4a): created successfully Apr 24 19:22:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e124db-b4ac-47c7-9db4-2eee790a68ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:37 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (6715da1a-61be-426a-ab38-e4e06b542d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:37 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0484e4f4-ac6e-45a9-acc1-e3306babb89b tempest-VolumesSnapshotTestJSON-1743295061 None] Created volume successfully. Apr 24 19:22:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Creating offline snapshot 2c35d73c-7d8c-4f38-9612-48a929ea4d3e of volume 090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:22:38 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c97642-b814-478b-b2be-608dc6529af2]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:38 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a Apr 24 19:22:38 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:39 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a" returned: 0 in 0.645s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:39 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e 1G Apr 24 19:22:39 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:40 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e 1G" returned: 0 in 0.634s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090828a5-7ec8-4d86-b721-56e304c61b4a -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:40 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090828a5-7ec8-4d86-b721-56e304c61b4a -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e Apr 24 19:22:40 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:40 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090828a5-7ec8-4d86-b721-56e304c61b4a -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e" returned: 0 in 0.523s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:40 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e is being set with open permissions: ugo+rw Apr 24 19:22:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:40 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e Apr 24 19:22:40 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:41 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e" returned: 0 in 0.475s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:41 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.info Apr 24 19:22:41 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:41 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.info" returned: 0 in 0.465s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:41 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.info is being set with open permissions: ugo+rw Apr 24 19:22:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:41 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.info Apr 24 19:22:41 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:42 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.info" returned: 0 in 0.543s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.409s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:42 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4d3492a1-7dd6-45ae-b332-81b48cb28bb4 tempest-VolumesSnapshotTestJSON-1743295061 None] Create snapshot completed successfully Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (e6c4128e-8c71-4df1-84b7-2c097418c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e6c311-e78d-4d94-b226-2e6e6f214420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e6c311-e78d-4d94-b226-2e6e6f214420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1263779266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49feb028-7b22-406f-834c-811b36b03097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88fdf07f7b044adbefcf171b168b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2c35d73c-7d8c-4f38-9612-48a929ea4d3e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:43Z,use_quota=True,user_id='c906f274a8224f8dbfe8edcee3e1be8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe84dce-e9bc-4cd2-b3ae-f4b5e14d2ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe84dce-e9bc-4cd2-b3ae-f4b5e14d2ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e514837-7da1-45b6-995a-734ce2e74f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e514837-7da1-45b6-995a-734ce2e74f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '49feb028-7b22-406f-834c-811b36b03097', 'volume_name': 'volume-49feb028-7b22-406f-834c-811b36b03097', 'volume_size': 2, 'snapshot_id': '2c35d73c-7d8c-4f38-9612-48a929ea4d3e'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4364beef-c2db-4643-9438-fd4bbe43428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4364beef-c2db-4643-9438-fd4bbe43428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3cdb4c-bb13-4152-b0f8-44559ebce96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:43 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Volume 49feb028-7b22-406f-834c-811b36b03097: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-49feb028-7b22-406f-834c-811b36b03097', 'volume_size': 2, 'snapshot_id': '2c35d73c-7d8c-4f38-9612-48a929ea4d3e'} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-2c35d73c-7d8c-4f38-9612-48a929ea4d3e-49feb028-7b22-406f-834c-811b36b03097" by "_create_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-2c35d73c-7d8c-4f38-9612-48a929ea4d3e-49feb028-7b22-406f-834c-811b36b03097" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Creating volume 49feb028-7b22-406f-834c-811b36b03097 from snapshot 2c35d73c-7d8c-4f38-9612-48a929ea4d3e {{(pid=81522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-49feb028-7b22-406f-834c-811b36b03097" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-49feb028-7b22-406f-834c-811b36b03097" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] snapshot: 2c35d73c-7d8c-4f38-9612-48a929ea4d3e, volume: 49feb028-7b22-406f-834c-811b36b03097, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d6308-7a16-4e6b-afe3-029e0fc61dc0]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:43 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e Apr 24 19:22:43 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:44 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e" returned: 0 in 0.684s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090828a5-7ec8-4d86-b721-56e304c61b4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:22:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:22:44 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a58426-45d0-4d74-a7ab-4316fab3bdeb]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:44 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a Apr 24 19:22:44 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:44 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a" returned: 0 in 0.722s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:44 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:22:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:45 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 Apr 24 19:22:45 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:50 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097" returned: 0 in 5.847s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:50 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e20226e-3796-4e0e-a62f-42f940626632]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:50 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a Apr 24 19:22:50 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:51 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a" returned: 0 in 0.705s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:51 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:22:51 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Converted 1024.00 MB image at 175.11 MB/s Apr 24 19:22:51 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 is being set with open permissions: ugo+rw Apr 24 19:22:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:51 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 Apr 24 19:22:51 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:52 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097" returned: 0 in 0.521s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-49feb028-7b22-406f-834c-811b36b03097" released by "_copy_volume_from_snapshot" :: held 8.583s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-2c35d73c-7d8c-4f38-9612-48a929ea4d3e-49feb028-7b22-406f-834c-811b36b03097" released by "_create_volume_from_snapshot" :: held 8.614s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.631s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3cdb4c-bb13-4152-b0f8-44559ebce96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49feb028-7b22-406f-834c-811b36b03097', 'volume_size': 2, 'snapshot_id': '2c35d73c-7d8c-4f38-9612-48a929ea4d3e'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217df571-b5d4-4c35-bf36-00929ea3efac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:52 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Volume volume-49feb028-7b22-406f-834c-811b36b03097 (49feb028-7b22-406f-834c-811b36b03097): created successfully Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217df571-b5d4-4c35-bf36-00929ea3efac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (e6c4128e-8c71-4df1-84b7-2c097418c122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b4babd51-744b-4f38-8dda-8ad182d90f97 tempest-VolumesSnapshotTestJSON-1743295061 None] Created volume successfully. Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-49feb028-7b22-406f-834c-811b36b03097-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-49feb028-7b22-406f-834c-811b36b03097-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-49feb028-7b22-406f-834c-811b36b03097" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-49feb028-7b22-406f-834c-811b36b03097" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a605114e-b474-4e63-ae76-50db1c40d6b3]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:52 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 Apr 24 19:22:52 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:53 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097" returned: 0 in 0.591s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:53 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097 Apr 24 19:22:53 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:53 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-49feb028-7b22-406f-834c-811b36b03097" returned: 0 in 0.752s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-49feb028-7b22-406f-834c-811b36b03097" released by "delete_volume" :: held 1.397s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:53 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Created reservations ['64dee9e4-a37b-4185-8f03-5788357ad773', '27133ed2-9a3f-4f4b-986e-cfd1429ccd60', '573ea1e6-f875-4253-a592-ef3f14e19ba2', '106bc667-0f38-49bc-b332-2ece15e31a7d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:54 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:22:54 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:54 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.546s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:54 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Deleted volume successfully. Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4e251b71-f9d9-486a-ba43-8f4441aa557c tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-49feb028-7b22-406f-834c-811b36b03097-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-2c35d73c-7d8c-4f38-9612-48a929ea4d3e-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-2c35d73c-7d8c-4f38-9612-48a929ea4d3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-090828a5-7ec8-4d86-b721-56e304c61b4a" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-090828a5-7ec8-4d86-b721-56e304c61b4a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-2c35d73c-7d8c-4f38-9612-48a929ea4d3e" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-2c35d73c-7d8c-4f38-9612-48a929ea4d3e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Deleting offline snapshot 2c35d73c-7d8c-4f38-9612-48a929ea4d3e of volume 090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] snapshot_file for this snap is: volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e3fd9e-fafb-4034-863a-50d3567eb64c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:55 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e Apr 24 19:22:55 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:55 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e" returned: 0 in 0.613s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090828a5-7ec8-4d86-b721-56e304c61b4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:55 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18fe114-3b2d-4135-aab0-3885ff467bff]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:55 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a Apr 24 19:22:55 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:56 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a" returned: 0 in 0.915s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:56 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e Apr 24 19:22:56 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:57 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e" returned: 0 in 0.841s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:57 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e Apr 24 19:22:57 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:57 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a.2c35d73c-7d8c-4f38-9612-48a929ea4d3e" returned: 0 in 0.479s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-2c35d73c-7d8c-4f38-9612-48a929ea4d3e" released by "_delete_snapshot" :: held 3.008s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-090828a5-7ec8-4d86-b721-56e304c61b4a" released by "delete_snapshot" :: held 3.043s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:57 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Created reservations ['06e26d4a-3610-4ed0-868b-6e0dea927542', '19da41a4-7729-442f-9489-b4ea4e61ece9', '20ed5401-0674-44c9-8638-bfb6e67fa7aa', 'e57da4ec-64b3-4e52-9c47-a4b918b5e38d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-51e88d0c-45d4-4dc8-9594-8a7693d00dba tempest-VolumesActionsTest-434246189 None] Acquiring lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370" by "attach_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Delete snapshot completed successfully. Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-057fded3-7cd3-4393-aa06-e59bccb95b86 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-2c35d73c-7d8c-4f38-9612-48a929ea4d3e-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-51e88d0c-45d4-4dc8-9594-8a7693d00dba tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370" acquired by "attach_volume" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-51e88d0c-45d4-4dc8-9594-8a7693d00dba tempest-VolumesActionsTest-434246189 None] Attaching volume a7c9b4bc-1220-4699-9626-659ba35e0370 to instance f10924ae-48e1-4076-8269-22eb2fe1417e at mountpoint /dev/vdb on host None. Apr 24 19:22:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-51e88d0c-45d4-4dc8-9594-8a7693d00dba tempest-VolumesActionsTest-434246189 None] Attach volume completed successfully. Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-51e88d0c-45d4-4dc8-9594-8a7693d00dba tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370" released by "attach_volume" :: held 0.129s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-090828a5-7ec8-4d86-b721-56e304c61b4a-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-090828a5-7ec8-4d86-b721-56e304c61b4a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-090828a5-7ec8-4d86-b721-56e304c61b4a" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-090828a5-7ec8-4d86-b721-56e304c61b4a" acquired by "delete_volume" :: waited 0.026s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d18655c-b8d0-4e89-aa94-a93d18e89527]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:58 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a Apr 24 19:22:58 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4c8eec86-b048-4bb8-aafa-3e22cb713142 tempest-VolumesActionsTest-434246189 None] Acquiring lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370-detach_volume" by "detach_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4c8eec86-b048-4bb8-aafa-3e22cb713142 tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4c8eec86-b048-4bb8-aafa-3e22cb713142 tempest-VolumesActionsTest-434246189 None] Detaching volume a7c9b4bc-1220-4699-9626-659ba35e0370 from instance f10924ae-48e1-4076-8269-22eb2fe1417e. Apr 24 19:22:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4c8eec86-b048-4bb8-aafa-3e22cb713142 tempest-VolumesActionsTest-434246189 None] Detach volume completed successfully. Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-4c8eec86-b048-4bb8-aafa-3e22cb713142 tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:58 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a" returned: 0 in 0.612s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:58 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a Apr 24 19:22:58 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:59 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-090828a5-7ec8-4d86-b721-56e304c61b4a" returned: 0 in 0.516s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-090828a5-7ec8-4d86-b721-56e304c61b4a" released by "delete_volume" :: held 1.201s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:59 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Created reservations ['f76a5b3f-08fa-4e0a-8cf5-46581108af7c', '02de2d4d-2c9a-4b7f-adc8-33e9ba247397', '69ba6429-5a35-4e8e-bd5f-27633b1bc7be', '294b106e-ec60-43f1-b47e-493ec331026d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:59 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:22:59 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:00 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.552s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:00 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:00 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Deleted volume successfully. Apr 24 19:23:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-dff1dbd2-0cba-42b0-940f-26fdc1d56390 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-090828a5-7ec8-4d86-b721-56e304c61b4a-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (c56022ec-723e-4028-a0c3-c17746cb1a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d775a5a9-fe88-4df0-8f2a-73d9887c4a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d775a5a9-fe88-4df0-8f2a-73d9887c4a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1790689372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f0f660-cab0-4416-a11c-bb12f958060b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88fdf07f7b044adbefcf171b168b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:01Z,use_quota=True,user_id='c906f274a8224f8dbfe8edcee3e1be8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59222eb-bd52-417f-a5e5-19e9bad80aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59222eb-bd52-417f-a5e5-19e9bad80aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361208b0-aa77-4c03-9b53-e224875cb4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361208b0-aa77-4c03-9b53-e224875cb4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f0f660-cab0-4416-a11c-bb12f958060b', 'volume_name': 'volume-d2f0f660-cab0-4416-a11c-bb12f958060b', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1538e64-9d47-4962-a94e-f364c1837974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1538e64-9d47-4962-a94e-f364c1837974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87981969-107e-40ad-b264-fe2e8ea2340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:01 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Volume d2f0f660-cab0-4416-a11c-bb12f958060b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f0f660-cab0-4416-a11c-bb12f958060b', 'volume_size': 1} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1790689372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f0f660-cab0-4416-a11c-bb12f958060b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88fdf07f7b044adbefcf171b168b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:01Z,use_quota=True,user_id='c906f274a8224f8dbfe8edcee3e1be8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Creating volume d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:01 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:01 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b 1073741824 Apr 24 19:23:01 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:01 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b 1073741824" returned: 0 in 0.711s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:02 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b Apr 24 19:23:02 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:02 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b" returned: 0 in 0.619s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87981969-107e-40ad-b264-fe2e8ea2340a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f0f660-cab0-4416-a11c-bb12f958060b', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88b3493-3337-4f01-a9b2-2931e75ddf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:02 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Volume volume-d2f0f660-cab0-4416-a11c-bb12f958060b (d2f0f660-cab0-4416-a11c-bb12f958060b): created successfully Apr 24 19:23:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88b3493-3337-4f01-a9b2-2931e75ddf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (c56022ec-723e-4028-a0c3-c17746cb1a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:02 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-cb0e6d90-81e1-441a-8530-323074cbeaae tempest-VolumesSnapshotTestJSON-1743295061 None] Created volume successfully. Apr 24 19:23:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Creating offline snapshot 4ae782b6-5b58-4c06-9b13-d7662654dd5a of volume d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:23:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcfb204-84b5-4b8c-b528-2dc75b93c8fe]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:03 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b Apr 24 19:23:03 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:04 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b" returned: 0 in 0.674s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:04 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a 1G Apr 24 19:23:04 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:04 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a 1G" returned: 0 in 0.631s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f0f660-cab0-4416-a11c-bb12f958060b -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:04 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f0f660-cab0-4416-a11c-bb12f958060b -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a Apr 24 19:23:04 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:05 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f0f660-cab0-4416-a11c-bb12f958060b -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a" returned: 0 in 0.512s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:05 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a is being set with open permissions: ugo+rw Apr 24 19:23:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:05 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a Apr 24 19:23:05 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:05 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a" returned: 0 in 0.444s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:05 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.info Apr 24 19:23:05 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:06 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.info" returned: 0 in 0.501s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:06 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.info is being set with open permissions: ugo+rw Apr 24 19:23:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:06 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.info Apr 24 19:23:06 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:06 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.info" returned: 0 in 0.446s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.302s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:06 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5d0480c1-2220-48ab-b478-f13b9c1c30a5 tempest-VolumesSnapshotTestJSON-1743295061 None] Create snapshot completed successfully Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (e8e4ed23-7191-42cb-9492-c6bd4ee8ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bceb84-9b40-4d7d-a2cf-89d43ece9f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bceb84-9b40-4d7d-a2cf-89d43ece9f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-297509644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed77a97-9603-44ea-86cb-9045a1c61c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88fdf07f7b044adbefcf171b168b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ae782b6-5b58-4c06-9b13-d7662654dd5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:08Z,use_quota=True,user_id='c906f274a8224f8dbfe8edcee3e1be8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ab8d04-962c-4a59-8fcb-0f4daa5484df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ab8d04-962c-4a59-8fcb-0f4daa5484df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d1b85b-b8cd-4f12-8ad4-432a4a0f90a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d1b85b-b8cd-4f12-8ad4-432a4a0f90a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ed77a97-9603-44ea-86cb-9045a1c61c93', 'volume_name': 'volume-3ed77a97-9603-44ea-86cb-9045a1c61c93', 'volume_size': 1, 'snapshot_id': '4ae782b6-5b58-4c06-9b13-d7662654dd5a'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfad9d41-240e-478d-98a4-4fbd3f34acc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfad9d41-240e-478d-98a4-4fbd3f34acc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8e7559-e366-4f45-a9a6-0492c4c75f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:08 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Volume 3ed77a97-9603-44ea-86cb-9045a1c61c93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ed77a97-9603-44ea-86cb-9045a1c61c93', 'volume_size': 1, 'snapshot_id': '4ae782b6-5b58-4c06-9b13-d7662654dd5a'} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-4ae782b6-5b58-4c06-9b13-d7662654dd5a-3ed77a97-9603-44ea-86cb-9045a1c61c93" by "_create_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-4ae782b6-5b58-4c06-9b13-d7662654dd5a-3ed77a97-9603-44ea-86cb-9045a1c61c93" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Creating volume 3ed77a97-9603-44ea-86cb-9045a1c61c93 from snapshot 4ae782b6-5b58-4c06-9b13-d7662654dd5a {{(pid=81522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-3ed77a97-9603-44ea-86cb-9045a1c61c93" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-3ed77a97-9603-44ea-86cb-9045a1c61c93" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] snapshot: 4ae782b6-5b58-4c06-9b13-d7662654dd5a, volume: 3ed77a97-9603-44ea-86cb-9045a1c61c93, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e1aa5f-9680-4fa2-9451-df8378097aad]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:08 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a Apr 24 19:23:08 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:08 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a" returned: 0 in 0.611s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f0f660-cab0-4416-a11c-bb12f958060b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eaedfc-3b58-40f8-b6fb-1800f8fab173]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:08 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b Apr 24 19:23:08 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:09 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b" returned: 0 in 0.704s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:09 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:23:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:09 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 Apr 24 19:23:09 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:14 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93" returned: 0 in 4.888s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:14 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d216b81-48f1-41fe-b4d7-e4be95ee750e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:14 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b Apr 24 19:23:14 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:15 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b" returned: 0 in 0.636s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:23:15 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Converted 1024.00 MB image at 209.43 MB/s Apr 24 19:23:15 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 is being set with open permissions: ugo+rw Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:15 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 Apr 24 19:23:15 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:15 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93" returned: 0 in 0.491s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-3ed77a97-9603-44ea-86cb-9045a1c61c93" released by "_copy_volume_from_snapshot" :: held 7.442s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-4ae782b6-5b58-4c06-9b13-d7662654dd5a-3ed77a97-9603-44ea-86cb-9045a1c61c93" released by "_create_volume_from_snapshot" :: held 7.484s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.502s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.568s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f8753e-8421-4511-9916-21d5dee2ec14]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8e7559-e366-4f45-a9a6-0492c4c75f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed77a97-9603-44ea-86cb-9045a1c61c93', 'volume_size': 1, 'snapshot_id': '4ae782b6-5b58-4c06-9b13-d7662654dd5a'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3052216-392e-49c6-8263-549561021ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:15 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Volume volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 (3ed77a97-9603-44ea-86cb-9045a1c61c93): created successfully Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3052216-392e-49c6-8263-549561021ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:15 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Flow 'volume_create_manager' (e8e4ed23-7191-42cb-9492-c6bd4ee8ae88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:15 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 Apr 24 19:23:15 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:15 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-000e4b12-7980-43b3-9d69-d2c0afc6eeaa tempest-VolumesSnapshotTestJSON-1743295061 None] Created volume successfully. Apr 24 19:23:16 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370" returned: 0 in 0.550s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e511b101-a4b4-46bc-bac7-805f78a6256c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:16 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 Apr 24 19:23:16 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:16 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-3ed77a97-9603-44ea-86cb-9045a1c61c93-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370" returned: 0 in 0.590s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.7509007a-5ad1-4588-9b23-28256c7a729dnpysx26f.img {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-3ed77a97-9603-44ea-86cb-9045a1c61c93-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:16 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.7509007a-5ad1-4588-9b23-28256c7a729dnpysx26f.img Apr 24 19:23:16 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-3ed77a97-9603-44ea-86cb-9045a1c61c93" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-3ed77a97-9603-44ea-86cb-9045a1c61c93" acquired by "delete_volume" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[641aa863-8a83-4d49-94ac-906033393670]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:17 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 Apr 24 19:23:17 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:17 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93" returned: 0 in 0.754s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:17 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93 Apr 24 19:23:17 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:18 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3ed77a97-9603-44ea-86cb-9045a1c61c93" returned: 0 in 0.984s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-3ed77a97-9603-44ea-86cb-9045a1c61c93" released by "delete_volume" :: held 1.794s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:18 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Created reservations ['f6be7f8a-ee2e-473c-b002-e43099c721a5', 'bfdf91f7-8980-4ec9-8ced-2a5a95964692', 'be7a438d-c5a4-400b-82e2-c80a21f63ab6', '31deb0f6-26d9-4cd3-992b-f20934e3690f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:19 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:23:19 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-4ae782b6-5b58-4c06-9b13-d7662654dd5a-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-4ae782b6-5b58-4c06-9b13-d7662654dd5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-d2f0f660-cab0-4416-a11c-bb12f958060b" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-d2f0f660-cab0-4416-a11c-bb12f958060b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-4ae782b6-5b58-4c06-9b13-d7662654dd5a" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-4ae782b6-5b58-4c06-9b13-d7662654dd5a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Deleting offline snapshot 4ae782b6-5b58-4c06-9b13-d7662654dd5a of volume d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] snapshot_file for this snap is: volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[986c481c-5207-4add-b648-a1ff1aa9c319]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:19 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a Apr 24 19:23:19 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:19 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.892s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:19 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Deleted volume successfully. Apr 24 19:23:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e2d23939-5fd5-4e50-9b17-77082955228a tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-3ed77a97-9603-44ea-86cb-9045a1c61c93-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:21 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a" returned: 0 in 1.596s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f0f660-cab0-4416-a11c-bb12f958060b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeecedb-ace7-4e5d-91bd-1234628d85d2]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:21 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b Apr 24 19:23:21 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:21 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:23:21 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:21 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.7509007a-5ad1-4588-9b23-28256c7a729dnpysx26f.img" returned: 0 in 4.822s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5253821-7a1b-4e43-a920-8ea9862775ed]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:21 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 Apr 24 19:23:21 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:21 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.574s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:21 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b" returned: 0 in 0.787s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:21 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a Apr 24 19:23:21 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:22 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370" returned: 0 in 0.645s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:22 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.7509007a-5ad1-4588-9b23-28256c7a729dnpysx26f.img {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:23:22 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Converted 1024.00 MB image at 212.31 MB/s Apr 24 19:23:22 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=67,cinder:UPDATE=61,cinder:INSERT=18,cinder:DELETE=5 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:23:22 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=69,cinder:UPDATE=57,cinder:INSERT=12,cinder:DELETE=6 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:23:22 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] 7509007a-5ad1-4588-9b23-28256c7a729d was raw, no need to convert to raw {{(pid=81522) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 24 19:23:22 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a" returned: 0 in 0.564s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:22 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a Apr 24 19:23:22 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:23 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b.4ae782b6-5b58-4c06-9b13-d7662654dd5a" returned: 0 in 0.484s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-4ae782b6-5b58-4c06-9b13-d7662654dd5a" released by "_delete_snapshot" :: held 3.598s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-d2f0f660-cab0-4416-a11c-bb12f958060b" released by "delete_snapshot" :: held 3.635s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Created reservations ['59873f11-27a3-4852-8819-783ab3815ace', '40007509-00f7-433a-b367-0170e7796e5e', 'f1d034d9-865c-4dc7-8073-5d775f54b2c3', '87bdfd94-8844-47e4-8799-0ce0e0ac7e14'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:23 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Delete snapshot completed successfully. Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-036bbd9a-57f4-45bb-89d5-86e2437aabb0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-4ae782b6-5b58-4c06-9b13-d7662654dd5a-delete_snapshot" released by "delete_snapshot" :: held 3.802s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-d2f0f660-cab0-4416-a11c-bb12f958060b-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-d2f0f660-cab0-4416-a11c-bb12f958060b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-d2f0f660-cab0-4416-a11c-bb12f958060b" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-d2f0f660-cab0-4416-a11c-bb12f958060b" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c9094b-e35b-4b92-a31f-9d312965bc2d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:23 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b Apr 24 19:23:23 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:24 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b" returned: 0 in 0.564s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:24 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b Apr 24 19:23:24 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:24 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-d2f0f660-cab0-4416-a11c-bb12f958060b" returned: 0 in 0.451s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:24 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-d2f0f660-cab0-4416-a11c-bb12f958060b" released by "delete_volume" :: held 1.092s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:24 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Created reservations ['175a5f37-b6fd-4c83-b47a-db7815ba20b5', 'c544a005-a225-4d23-a7f0-3ef1575f0f1d', '85c2166d-bf9c-4854-888b-018f7e2de8e1', 'ad39c900-4191-4fbb-ac68-da39596d5c75'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:25 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:25 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:25 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:23:25 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:25 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.494s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:25 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:25 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Deleted volume successfully. Apr 24 19:23:25 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-3ae112bc-7c36-4259-bee0-c85c2f63e763 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-d2f0f660-cab0-4416-a11c-bb12f958060b-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-8220a8ac-1525-4049-8982-90dcf54fa241-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-8220a8ac-1525-4049-8982-90dcf54fa241-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "cinder-quobyte-8220a8ac-1525-4049-8982-90dcf54fa241" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-8220a8ac-1525-4049-8982-90dcf54fa241" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:26 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7609f89c-aeb6-4ef1-9858-399782ab603b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:26 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 Apr 24 19:23:26 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:26 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241" returned: 0 in 0.624s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:26 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241 Apr 24 19:23:26 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:27 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8220a8ac-1525-4049-8982-90dcf54fa241" returned: 0 in 0.559s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-quobyte-8220a8ac-1525-4049-8982-90dcf54fa241" released by "delete_volume" :: held 1.280s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:27 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Created reservations ['d5e42381-319b-4e73-99bf-977ba8cedb66', 'b04436f4-70c7-47d1-a146-12ec1410053f', '03dc5bb4-f3b1-4dcf-84d6-1fb5c56754c2', '8d2ca765-c9a0-41e3-b1b6-c3818bbc4c6b'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:27 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:23:27 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:28 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.475s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:28 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:28 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Deleted volume successfully. Apr 24 19:23:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f3a2375c-fc2a-4711-9e25-fb65169ea8a0 tempest-VolumesSnapshotTestJSON-1743295061 None] Lock "cinder-8220a8ac-1525-4049-8982-90dcf54fa241-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (f4976c16-f1de-441a-8195-38ed86cb8609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627ef7f3-c7b9-4ba3-8ad1-df47cdbe1b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627ef7f3-c7b9-4ba3-8ad1-df47cdbe1b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557323436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373c558b-e5ba-467b-817d-bdc0f6198fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:36Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8337ea01-1311-40b3-b60f-61e982e31c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8337ea01-1311-40b3-b60f-61e982e31c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fab7ef-685b-4ff9-905d-4d2a9db7da05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fab7ef-685b-4ff9-905d-4d2a9db7da05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373c558b-e5ba-467b-817d-bdc0f6198fe2', 'volume_name': 'volume-373c558b-e5ba-467b-817d-bdc0f6198fe2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e6d335-956f-4fdc-9a58-20d957aca879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e6d335-956f-4fdc-9a58-20d957aca879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168228a8-caee-40b4-be48-c21f5b19571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:35 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume 373c558b-e5ba-467b-817d-bdc0f6198fe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373c558b-e5ba-467b-817d-bdc0f6198fe2', 'volume_size': 1} Apr 24 19:23:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.897s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Uploaded volume to glance image-id: 7509007a-5ad1-4588-9b23-28256c7a729d. {{(pid=81522) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.893s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557323436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373c558b-e5ba-467b-817d-bdc0f6198fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:36Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Creating volume 373c558b-e5ba-467b-817d-bdc0f6198fe2 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:38 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:23:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:38 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 1073741824 Apr 24 19:23:38 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:38 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-3298009d-06bb-4381-a4f3-573ececa2d2e tempest-VolumesActionsTest-434246189 None] Copy volume to image completed successfully. Apr 24 19:23:39 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 1073741824" returned: 0 in 0.648s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:39 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 Apr 24 19:23:39 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:39 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2" returned: 0 in 0.476s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168228a8-caee-40b4-be48-c21f5b19571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373c558b-e5ba-467b-817d-bdc0f6198fe2', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3e20a2-2fe3-47d0-8784-8325d3dba147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:39 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 (373c558b-e5ba-467b-817d-bdc0f6198fe2): created successfully Apr 24 19:23:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3e20a2-2fe3-47d0-8784-8325d3dba147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (f4976c16-f1de-441a-8195-38ed86cb8609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:39 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-be488aef-0e2f-4b83-b981-98688c64e8bb tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created volume successfully. Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3448d05c-b388-486f-8552-56d6c3051276]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:40 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 Apr 24 19:23:40 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (4d285502-d982-44f3-b93a-3814d5d533be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61a1fe6-d8c5-485b-8499-7769530759d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61a1fe6-d8c5-485b-8499-7769530759d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402832770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a07e681-3ce2-4a36-8426-b897d8f0a1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:40Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02074a1b-f901-4eb5-a483-207340c6309b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02074a1b-f901-4eb5-a483-207340c6309b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074494db-cdda-4f3c-88b2-01c7c088a2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074494db-cdda-4f3c-88b2-01c7c088a2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a07e681-3ce2-4a36-8426-b897d8f0a1e8', 'volume_name': 'volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35417e15-e4b9-44a0-b54e-7e92612d9fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35417e15-e4b9-44a0-b54e-7e92612d9fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59550df-e473-4192-b798-857d2420c99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume 8a07e681-3ce2-4a36-8426-b897d8f0a1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8', 'volume_size': 1} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (36a5617b-de67-49b7-ae77-b5aabc0509eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a67c8a-e7c8-4f68-86f9-4cef2a17b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a67c8a-e7c8-4f68-86f9-4cef2a17b32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652877211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1712daed-a904-4a73-9053-5fa0054f3726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:41Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0207804-24b1-48f6-a373-eaf8ff87eff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0207804-24b1-48f6-a373-eaf8ff87eff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb02e57-0e35-477c-bbb2-b53c01748d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb02e57-0e35-477c-bbb2-b53c01748d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1712daed-a904-4a73-9053-5fa0054f3726', 'volume_name': 'volume-1712daed-a904-4a73-9053-5fa0054f3726', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63761ce-638b-494b-92be-e4e23eb32432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63761ce-638b-494b-92be-e4e23eb32432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfc4429-8462-47c4-bd31-647df94e9918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume 1712daed-a904-4a73-9053-5fa0054f3726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1712daed-a904-4a73-9053-5fa0054f3726', 'volume_size': 1} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:40 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370" returned: 0 in 0.664s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (d33f7518-41ca-4c2f-a72e-47688f139804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b69cdb-ce9b-4ef4-94e0-877d69d8da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d59d6b-2805-411b-8159-09e2acb923d8]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b69cdb-ce9b-4ef4-94e0-877d69d8da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494178500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73164417-755b-4971-915f-ce84cea26010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:41Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a54233b-5b52-4b20-a53c-cc5131380a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a54233b-5b52-4b20-a53c-cc5131380a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5faa3b-9231-4975-a25b-96e81912e670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5faa3b-9231-4975-a25b-96e81912e670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73164417-755b-4971-915f-ce84cea26010', 'volume_name': 'volume-73164417-755b-4971-915f-ce84cea26010', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3328e0-ac5a-4cc5-8e0e-3bf70185fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3328e0-ac5a-4cc5-8e0e-3bf70185fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94462899-5a90-4f03-ac84-01e7033c67e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume 73164417-755b-4971-915f-ce84cea26010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73164417-755b-4971-915f-ce84cea26010', 'volume_size': 1} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:41 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 Apr 24 19:23:41 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (c3d70f7b-cb08-4a6f-b2f1-bb67fb9d2bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3813e87-8384-40f6-810b-11306f1ac885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3813e87-8384-40f6-810b-11306f1ac885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-222111416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3893434b-a497-4497-ad65-354bb3d45283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:41Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42af359-e461-42a9-bdc9-362de453f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42af359-e461-42a9-bdc9-362de453f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75e47ad-30e1-478e-87b5-50be51f10136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75e47ad-30e1-478e-87b5-50be51f10136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3893434b-a497-4497-ad65-354bb3d45283', 'volume_name': 'volume-3893434b-a497-4497-ad65-354bb3d45283', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc990d6d-b2f8-4d9f-93c6-2510fcddf4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc990d6d-b2f8-4d9f-93c6-2510fcddf4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fcfcfb-49e0-46ef-b3a1-d85af11debd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume 3893434b-a497-4497-ad65-354bb3d45283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3893434b-a497-4497-ad65-354bb3d45283', 'volume_size': 1} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (91a9bee9-d5f6-423e-a5e2-b0401d55c39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f2c556-0ed5-411a-8848-26665d275707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f2c556-0ed5-411a-8848-26665d275707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947032164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491f71d9-6c84-40f7-b778-1b1c880b24dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:42Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a041e88b-7a29-404a-9d09-4e769f86e89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a041e88b-7a29-404a-9d09-4e769f86e89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327f132b-657a-42a6-9bc5-55c93bd2a3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327f132b-657a-42a6-9bc5-55c93bd2a3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491f71d9-6c84-40f7-b778-1b1c880b24dc', 'volume_name': 'volume-491f71d9-6c84-40f7-b778-1b1c880b24dc', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9c4bee-16b6-41e1-ba54-4112a3a49abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9c4bee-16b6-41e1-ba54-4112a3a49abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544e62b6-5699-4f29-8304-7d6c1312d361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:41 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume 491f71d9-6c84-40f7-b778-1b1c880b24dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491f71d9-6c84-40f7-b778-1b1c880b24dc', 'volume_size': 1} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:41 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370" returned: 0 in 0.710s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:41 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img Apr 24 19:23:41 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:46 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img" returned: 0 in 4.469s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:46 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3dd8b2-6d6d-4319-ad09-8bc54c218038]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:46 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 Apr 24 19:23:46 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:46 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370" returned: 0 in 0.710s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:46 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:23:46 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Converted 1024.00 MB image at 229.04 MB/s Apr 24 19:23:46 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] 3dd79058-a7a3-42b8-9627-944a30c28c55 was raw, converting to qcow2 {{(pid=81522) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 24 19:23:46 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4d1f19-e427-4567-bb06-c90e4e98cce6]: (4, 'raw') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:47 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img Apr 24 19:23:47 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:47 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img" returned: 0 in 0.513s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:47 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img Apr 24 19:23:47 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:47 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img" returned: 1 in 0.507s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img' failed. Not Retrying. {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:23:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img /opt/stack/data/cinder/conversion/vol_upload_egpnyhcc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:47 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img /opt/stack/data/cinder/conversion/vol_upload_egpnyhcc Apr 24 19:23:47 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:48 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img /opt/stack/data/cinder/conversion/vol_upload_egpnyhcc" returned: 0 in 0.446s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:48 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Image conversion details: src /opt/stack/data/cinder/conversion/a7c9b4bc-1220-4699-9626-659ba35e0370.temp_image.3dd79058-a7a3-42b8-9627-944a30c28c55335bxesv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_egpnyhcc {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:23:48 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 24 19:23:48 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34999c6-90a8-47ef-8c4b-2564fcc060b5]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_egpnyhcc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:48 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_egpnyhcc Apr 24 19:23:48 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:48 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_egpnyhcc" returned: 0 in 0.478s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.106s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Uploaded volume to glance image-id: 3dd79058-a7a3-42b8-9627-944a30c28c55. {{(pid=81522) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.938s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402832770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a07e681-3ce2-4a36-8426-b897d8f0a1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:40Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Creating volume 8a07e681-3ce2-4a36-8426-b897d8f0a1e8 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:50 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:23:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:50 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 1073741824 Apr 24 19:23:50 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:50 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e97e6b8b-d08b-4d72-9e9d-ac3d1ce5227e tempest-VolumesActionsTest-434246189 None] Copy volume to image completed successfully. Apr 24 19:23:51 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 1073741824" returned: 0 in 0.795s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Acquiring lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:51 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 Apr 24 19:23:51 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Acquiring lock "cinder-quobyte-a7c9b4bc-1220-4699-9626-659ba35e0370" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Lock "cinder-quobyte-a7c9b4bc-1220-4699-9626-659ba35e0370" acquired by "delete_volume" :: waited 0.032s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d634fe-6ea0-42f0-8fc5-b6d916eeb143]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:51 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 Apr 24 19:23:51 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:51 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8" returned: 0 in 0.550s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.144s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652877211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1712daed-a904-4a73-9053-5fa0054f3726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:41Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Creating volume 1712daed-a904-4a73-9053-5fa0054f3726 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:51 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:51 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726 1073741824 Apr 24 19:23:51 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59550df-e473-4192-b798-857d2420c99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345111da-1005-4553-8559-9271600a1d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:51 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 (8a07e681-3ce2-4a36-8426-b897d8f0a1e8): created successfully Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345111da-1005-4553-8559-9271600a1d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (4d285502-d982-44f3-b93a-3814d5d533be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:51 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9db591bd-c10b-46bb-85a7-91c11b8ebb88 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created volume successfully. Apr 24 19:23:51 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370" returned: 0 in 0.549s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:51 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370 Apr 24 19:23:51 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:52 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a7c9b4bc-1220-4699-9626-659ba35e0370" returned: 0 in 0.504s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Lock "cinder-quobyte-a7c9b4bc-1220-4699-9626-659ba35e0370" released by "delete_volume" :: held 1.105s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:52 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726 1073741824" returned: 0 in 0.692s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:52 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726 Apr 24 19:23:52 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Created reservations ['515af14e-7c4b-4e1a-bbcc-bca3048a74ef', '86ec0063-9e2b-4ff7-81c4-fd82d1eb761b', '038b79e4-bbf2-4124-8ac3-eb272a1ad6e8', '62b18c3f-946b-4a1e-a7e1-e3f10e7b3362'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:52 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:23:52 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:52 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726" returned: 0 in 0.462s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.914s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494178500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73164417-755b-4971-915f-ce84cea26010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:41Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Creating volume 73164417-755b-4971-915f-ce84cea26010 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:52 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:23:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfc4429-8462-47c4-bd31-647df94e9918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1712daed-a904-4a73-9053-5fa0054f3726', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43c6833-5a67-4a94-ab13-6a7ad86f1c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:53 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010 1073741824 Apr 24 19:23:53 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:53 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume volume-1712daed-a904-4a73-9053-5fa0054f3726 (1712daed-a904-4a73-9053-5fa0054f3726): created successfully Apr 24 19:23:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43c6833-5a67-4a94-ab13-6a7ad86f1c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:53 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (36a5617b-de67-49b7-ae77-b5aabc0509eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:53 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f960795e-27eb-44b2-b613-b9a89d459704 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created volume successfully. Apr 24 19:23:53 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.453s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:53 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:53 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Deleted volume successfully. Apr 24 19:23:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-8701e2ba-ceed-4880-81c6-02ab2aac92e9 tempest-VolumesActionsTest-434246189 None] Lock "cinder-a7c9b4bc-1220-4699-9626-659ba35e0370-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:53 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010 1073741824" returned: 0 in 0.662s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:53 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010 Apr 24 19:23:53 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:54 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010" returned: 0 in 0.463s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.819s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-222111416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3893434b-a497-4497-ad65-354bb3d45283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:41Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Creating volume 3893434b-a497-4497-ad65-354bb3d45283 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:54 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94462899-5a90-4f03-ac84-01e7033c67e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73164417-755b-4971-915f-ce84cea26010', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269fc1ec-d946-4f81-a582-ce808e1098b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:54 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283 1073741824 Apr 24 19:23:54 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:54 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume volume-73164417-755b-4971-915f-ce84cea26010 (73164417-755b-4971-915f-ce84cea26010): created successfully Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269fc1ec-d946-4f81-a582-ce808e1098b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (d33f7518-41ca-4c2f-a72e-47688f139804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:54 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-78140971-66be-405a-974b-1142a31fe5b7 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created volume successfully. Apr 24 19:23:54 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283 1073741824" returned: 0 in 0.766s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:54 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283 Apr 24 19:23:54 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:55 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283" returned: 0 in 0.492s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.790s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947032164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491f71d9-6c84-40f7-b778-1b1c880b24dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f88349c44614a95bcc4fac6d8d5301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:42Z,use_quota=True,user_id='f60fd7af4bf74a37abb5409638c68070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Creating volume 491f71d9-6c84-40f7-b778-1b1c880b24dc {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:55 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fcfcfb-49e0-46ef-b3a1-d85af11debd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3893434b-a497-4497-ad65-354bb3d45283', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905fd974-8424-48ae-bdaf-1d376ca7a058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:55 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc 1073741824 Apr 24 19:23:55 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:55 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume volume-3893434b-a497-4497-ad65-354bb3d45283 (3893434b-a497-4497-ad65-354bb3d45283): created successfully Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905fd974-8424-48ae-bdaf-1d376ca7a058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:55 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (c3d70f7b-cb08-4a6f-b2f1-bb67fb9d2bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:55 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5af87e90-f7e3-4352-8264-f83e910a5a32 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created volume successfully. Apr 24 19:23:56 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc 1073741824" returned: 0 in 0.760s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:56 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc Apr 24 19:23:56 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:56 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc" returned: 0 in 0.514s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:56 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544e62b6-5699-4f29-8304-7d6c1312d361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491f71d9-6c84-40f7-b778-1b1c880b24dc', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8ac221-a52c-428c-be82-875e81b06cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:56 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Volume volume-491f71d9-6c84-40f7-b778-1b1c880b24dc (491f71d9-6c84-40f7-b778-1b1c880b24dc): created successfully Apr 24 19:23:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8ac221-a52c-428c-be82-875e81b06cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:56 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Flow 'volume_create_manager' (91a9bee9-d5f6-423e-a5e2-b0401d55c39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:56 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-152e6e62-830c-4a57-8f7c-429030b556c2 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created volume successfully. Apr 24 19:23:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-491f71d9-6c84-40f7-b778-1b1c880b24dc-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-491f71d9-6c84-40f7-b778-1b1c880b24dc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-quobyte-491f71d9-6c84-40f7-b778-1b1c880b24dc" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:57 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-491f71d9-6c84-40f7-b778-1b1c880b24dc" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:57 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad04a41-ee20-4c77-b58b-fb3aaec280aa]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:57 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc Apr 24 19:23:57 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:57 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc" returned: 0 in 0.611s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:57 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc Apr 24 19:23:57 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:58 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-491f71d9-6c84-40f7-b778-1b1c880b24dc" returned: 0 in 0.523s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-491f71d9-6c84-40f7-b778-1b1c880b24dc" released by "delete_volume" :: held 1.192s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:58 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created reservations ['3ccf8e2b-c34a-4ce2-86b7-66e2a17ef93d', 'd92417f4-1186-480f-b447-d2a5cdd814db', '96bd5d99-a2b0-4662-8388-7c2797e91b8f', '758060aa-da84-42b8-9177-31fcd785758f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:58 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:23:58 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:59 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.523s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Deleted volume successfully. Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fd39f1c7-fb75-4f7e-b0a5-da47ce904341 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-491f71d9-6c84-40f7-b778-1b1c880b24dc-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-3893434b-a497-4497-ad65-354bb3d45283-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-3893434b-a497-4497-ad65-354bb3d45283-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-quobyte-3893434b-a497-4497-ad65-354bb3d45283" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-3893434b-a497-4497-ad65-354bb3d45283" acquired by "delete_volume" :: waited 0.028s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea2232f-1758-42dc-b34f-b00ba3097c60]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:59 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283 Apr 24 19:23:59 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Flow 'volume_create_manager' (4aacc59c-e659-4243-93a9-ccac2f17d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565d5578-2599-4bcd-80fa-8ae472261c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565d5578-2599-4bcd-80fa-8ae472261c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1081127238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f239f3aa-b35a-4121-8c5b-2d30b1395b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37fe440d05049fa8ec6453ad3a91667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:00Z,use_quota=True,user_id='714294550b304bbfad0b5452bdff7763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75d5bab-cad4-40c5-9bc1-fa49a2da3236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75d5bab-cad4-40c5-9bc1-fa49a2da3236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9bc025-0be0-4060-9023-ca7c5ca1ade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9bc025-0be0-4060-9023-ca7c5ca1ade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f239f3aa-b35a-4121-8c5b-2d30b1395b52', 'volume_name': 'volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e79557-8092-4041-82df-73bc186ed56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e79557-8092-4041-82df-73bc186ed56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214b8463-1c4a-412b-be20-6bd2cff8b8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:59 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Volume f239f3aa-b35a-4121-8c5b-2d30b1395b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52', 'volume_size': 1} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1081127238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f239f3aa-b35a-4121-8c5b-2d30b1395b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37fe440d05049fa8ec6453ad3a91667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:00Z,use_quota=True,user_id='714294550b304bbfad0b5452bdff7763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Creating volume f239f3aa-b35a-4121-8c5b-2d30b1395b52 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:59 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:23:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:59 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 1073741824 Apr 24 19:23:59 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:00 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283" returned: 0 in 0.614s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:00 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283 Apr 24 19:24:00 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:00 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 1073741824" returned: 0 in 0.870s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:00 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:00 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 Apr 24 19:24:00 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3893434b-a497-4497-ad65-354bb3d45283" returned: 0 in 0.588s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-3893434b-a497-4497-ad65-354bb3d45283" released by "delete_volume" :: held 1.262s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created reservations ['8e63c8cd-fb9b-4c97-85b1-719e6fd3bd62', 'faa9f82f-f60b-4fe1-afe7-ee0bc245524b', '0613e7fa-b31c-4c8b-a998-ec0896c307a1', 'f8368792-a7bf-48b7-a360-a60940f155b0'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:00 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:24:00 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:01 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52" returned: 0 in 0.599s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214b8463-1c4a-412b-be20-6bd2cff8b8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c309b29d-5d37-4dda-ade1-4dcc2ae87136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:01 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Volume volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 (f239f3aa-b35a-4121-8c5b-2d30b1395b52): created successfully Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c309b29d-5d37-4dda-ade1-4dcc2ae87136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Flow 'volume_create_manager' (4aacc59c-e659-4243-93a9-ccac2f17d809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:01 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a80bba50-1110-45a4-b162-36a064e7d326 tempest-VolumesNegativeTest-1896859681 None] Created volume successfully. Apr 24 19:24:01 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.574s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:01 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Deleted volume successfully. Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-46d7b33e-4e80-4ea2-9d59-12f27d387232 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-3893434b-a497-4497-ad65-354bb3d45283-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-73164417-755b-4971-915f-ce84cea26010-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-73164417-755b-4971-915f-ce84cea26010-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-quobyte-73164417-755b-4971-915f-ce84cea26010" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-73164417-755b-4971-915f-ce84cea26010" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bf26c5-71b9-47b0-8fc6-04186298aa86]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:01 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010 Apr 24 19:24:01 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:02 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010" returned: 0 in 0.679s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:02 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010 Apr 24 19:24:02 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:03 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-73164417-755b-4971-915f-ce84cea26010" returned: 0 in 0.565s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-73164417-755b-4971-915f-ce84cea26010" released by "delete_volume" :: held 1.289s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created reservations ['825e547c-b503-4c9d-b346-5994468ce334', 'c17a0048-f316-4ccd-b6c3-f6dfbd9996e9', 'fb1e7014-006a-4a23-8b41-7b9d5475e763', 'd5e9695c-264d-4ce4-a76f-6bb8cf2468c0'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:03 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:24:03 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:03 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.561s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:03 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Deleted volume successfully. Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-df8271ba-3cf7-45f3-9948-0bac79bf87b8 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-73164417-755b-4971-915f-ce84cea26010-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-1712daed-a904-4a73-9053-5fa0054f3726-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-1712daed-a904-4a73-9053-5fa0054f3726-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-quobyte-1712daed-a904-4a73-9053-5fa0054f3726" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-1712daed-a904-4a73-9053-5fa0054f3726" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:04 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb06b6e5-68bb-4201-a513-14e0d681ff01]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:04 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726 Apr 24 19:24:04 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:04 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726" returned: 0 in 0.580s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:04 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726 Apr 24 19:24:04 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:05 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1712daed-a904-4a73-9053-5fa0054f3726" returned: 0 in 0.484s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-1712daed-a904-4a73-9053-5fa0054f3726" released by "delete_volume" :: held 1.116s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created reservations ['b68a10fc-64c7-4d81-a4b5-368ab564d90f', 'b3ea72b5-0236-40d2-a2fc-cd5a2bde278b', '132219c3-ed6a-487c-a32d-d74051588479', 'd99d22c7-06d9-4781-943d-a38ac32d916a'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:05 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:24:05 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:05 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.460s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:05 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Deleted volume successfully. Apr 24 19:24:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d766ad69-3f67-4173-94aa-064ae2d866ca tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-1712daed-a904-4a73-9053-5fa0054f3726-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-8a07e681-3ce2-4a36-8426-b897d8f0a1e8-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-8a07e681-3ce2-4a36-8426-b897d8f0a1e8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-quobyte-8a07e681-3ce2-4a36-8426-b897d8f0a1e8" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-8a07e681-3ce2-4a36-8426-b897d8f0a1e8" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:06 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[489d6f16-dc2e-414d-b7ff-db607785d717]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:06 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 Apr 24 19:24:06 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:06 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8" returned: 0 in 0.542s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:06 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8 Apr 24 19:24:06 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:07 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8a07e681-3ce2-4a36-8426-b897d8f0a1e8" returned: 0 in 0.509s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-8a07e681-3ce2-4a36-8426-b897d8f0a1e8" released by "delete_volume" :: held 1.096s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:07 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created reservations ['3107f081-beaa-4d9d-8549-b837b34f108d', '561a6a52-09fb-49b4-b127-6d73f1def989', 'b67f1cce-d928-4c08-8c33-54b0fb393b75', 'a838dacd-9e69-4d8e-99bd-5e9914ca16bd'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:07 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:24:07 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:08 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.558s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:08 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:08 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Deleted volume successfully. Apr 24 19:24:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-6217ff3f-c7b0-4423-a402-fb8f24878739 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-8a07e681-3ce2-4a36-8426-b897d8f0a1e8-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-373c558b-e5ba-467b-817d-bdc0f6198fe2-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-373c558b-e5ba-467b-817d-bdc0f6198fe2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "cinder-quobyte-373c558b-e5ba-467b-817d-bdc0f6198fe2" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-373c558b-e5ba-467b-817d-bdc0f6198fe2" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:08 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96f1c1c-31fd-4573-88ef-5d8250500772]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:08 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 Apr 24 19:24:08 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:09 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2" returned: 0 in 0.652s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:09 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2 Apr 24 19:24:09 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:10 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-373c558b-e5ba-467b-817d-bdc0f6198fe2" returned: 0 in 0.672s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-quobyte-373c558b-e5ba-467b-817d-bdc0f6198fe2" released by "delete_volume" :: held 1.367s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Created reservations ['a7d4e919-f53a-4045-9018-1d7a7e5fd2be', 'e866d8e7-9094-4d2b-aafb-968c11b299c7', '326c0379-edbf-4b82-a47d-1b73ec51c8d3', 'dbe11b6c-7030-4bd1-a920-61a2b2b7f728'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:10 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:24:10 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:10 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.478s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Deleted volume successfully. Apr 24 19:24:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-b0a3fa72-9a67-421b-a5ea-8fb93424b730 tempest-CreateVolumesFromSourceVolumeTest-206407823 None] Lock "cinder-373c558b-e5ba-467b-817d-bdc0f6198fe2-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:20 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=68,cinder:INSERT=28,cinder:UPDATE=100,cinder:DELETE=3 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:24:20 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=67,cinder:INSERT=19,cinder:UPDATE=100,cinder:DELETE=13 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:24:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:24:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:21 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:24:21 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:22 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.716s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Acquiring lock "cinder-f239f3aa-b35a-4121-8c5b-2d30b1395b52-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Lock "cinder-f239f3aa-b35a-4121-8c5b-2d30b1395b52-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Acquiring lock "cinder-quobyte-f239f3aa-b35a-4121-8c5b-2d30b1395b52" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:34 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Lock "cinder-quobyte-f239f3aa-b35a-4121-8c5b-2d30b1395b52" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:34 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4aa656-191a-4e4f-bf91-2e9cdf87e7c9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:34 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 Apr 24 19:24:34 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:35 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52" returned: 0 in 0.620s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:35 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52 Apr 24 19:24:35 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:35 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f239f3aa-b35a-4121-8c5b-2d30b1395b52" returned: 0 in 0.535s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Lock "cinder-quobyte-f239f3aa-b35a-4121-8c5b-2d30b1395b52" released by "delete_volume" :: held 1.215s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Created reservations ['d318edfa-9e66-4174-89e0-296912c56aa0', '4ab24f0c-bb59-4460-b11d-3d45b20b3ccb', '4778c39c-f393-43f7-83a1-f4b6f993b07c', '2fc4b21f-2003-4a32-9440-d3012cfc8021'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:36 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:24:36 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:36 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.542s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:36 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Deleted volume successfully. Apr 24 19:24:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7512ee61-db8d-4fca-b24b-c16c76d03017 tempest-VolumesNegativeTest-1896859681 None] Lock "cinder-f239f3aa-b35a-4121-8c5b-2d30b1395b52-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Flow 'volume_create_manager' (076adce1-3f87-4448-815a-ae2511e9f8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba08c51-899b-408e-93ca-f947b917dccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba08c51-899b-408e-93ca-f947b917dccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-164330031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e983a812-475c-40e7-8fb7-fba0b6d863a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026a0c9246114365900b46a8d64262ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='c82fab15babf45ee9745dc1caa33c43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68574b89-c302-40c1-b4a5-8f05b55c8755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68574b89-c302-40c1-b4a5-8f05b55c8755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1882af8-be11-4cec-8583-6135e3f63302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1882af8-be11-4cec-8583-6135e3f63302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e983a812-475c-40e7-8fb7-fba0b6d863a5', 'volume_name': 'volume-e983a812-475c-40e7-8fb7-fba0b6d863a5', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b43bbe-13a8-4801-9599-38ffb4c92dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b43bbe-13a8-4801-9599-38ffb4c92dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeab8675-2617-40af-9752-5d4ebb3332dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Volume e983a812-475c-40e7-8fb7-fba0b6d863a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e983a812-475c-40e7-8fb7-fba0b6d863a5', 'volume_size': 1} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-164330031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e983a812-475c-40e7-8fb7-fba0b6d863a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026a0c9246114365900b46a8d64262ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='c82fab15babf45ee9745dc1caa33c43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Creating volume e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:43 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:24:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:43 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 1073741824 Apr 24 19:24:43 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Flow 'volume_create_manager' (7da2af07-a95a-477b-9d77-c4e6aa92faf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7669e27c-4967-48c5-bce3-417c09fdf955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7669e27c-4967-48c5-bce3-417c09fdf955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5517f7-38f3-4fbd-95d6-6b50a7912ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2de313c29d4d419c36a9be2189c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='d4459b46c4ae476ba4d5510d5d1bd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d2dbbb-b25b-4427-9cff-46b452aabfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d2dbbb-b25b-4427-9cff-46b452aabfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be844894-b30f-4e77-ad05-eb5ee4fefd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be844894-b30f-4e77-ad05-eb5ee4fefd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5517f7-38f3-4fbd-95d6-6b50a7912ba4', 'volume_name': 'volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d48e35a-c721-4136-8bc8-cd1d5e952947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d48e35a-c721-4136-8bc8-cd1d5e952947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f3d43c-3e68-4096-ae60-451a3db60bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Volume 6e5517f7-38f3-4fbd-95d6-6b50a7912ba4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4', 'volume_size': 1} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:44 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 1073741824" returned: 0 in 0.761s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:44 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 Apr 24 19:24:44 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:45 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5" returned: 0 in 0.459s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5517f7-38f3-4fbd-95d6-6b50a7912ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2de313c29d4d419c36a9be2189c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='d4459b46c4ae476ba4d5510d5d1bd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Creating volume 6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:45 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:45 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 1073741824 Apr 24 19:24:45 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeab8675-2617-40af-9752-5d4ebb3332dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e983a812-475c-40e7-8fb7-fba0b6d863a5', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc1c9bd-b4ef-4bb0-bb97-952024336a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:45 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Volume volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 (e983a812-475c-40e7-8fb7-fba0b6d863a5): created successfully Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc1c9bd-b4ef-4bb0-bb97-952024336a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Flow 'volume_create_manager' (076adce1-3f87-4448-815a-ae2511e9f8d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:45 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-55a15731-f893-4ad9-a4be-8a0b5c61ab01 tempest-SnapshotDependencyTests-1344002524 None] Created volume successfully. Apr 24 19:24:45 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 1073741824" returned: 0 in 0.617s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:45 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 Apr 24 19:24:45 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:46 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4" returned: 0 in 0.540s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.086s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f3d43c-3e68-4096-ae60-451a3db60bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8a2533-76a1-4c55-9ce7-5c2526aedec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Creating offline snapshot 0235bb9e-c789-4be6-9cd6-8743c0f6e07e of volume e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:24:46 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Volume volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 (6e5517f7-38f3-4fbd-95d6-6b50a7912ba4): created successfully Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8a2533-76a1-4c55-9ce7-5c2526aedec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Flow 'volume_create_manager' (7da2af07-a95a-477b-9d77-c4e6aa92faf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[941d7cc9-8a89-4e68-9735-013e0f1ab0ca]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:46 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-22bf5aac-d369-4d11-aaac-a77a5617cede tempest-CinderUnicodeTest-220131027 None] Created volume successfully. Apr 24 19:24:46 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 Apr 24 19:24:46 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:47 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5" returned: 0 in 0.624s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:47 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e 1G Apr 24 19:24:47 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:47 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e 1G" returned: 0 in 0.619s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:47 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e Apr 24 19:24:47 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Flow 'volume_create_manager' (d4c50fb3-7fda-40ea-a313-d412e1d83f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407ba476-f4e5-4a99-afc5-f33bd8148167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407ba476-f4e5-4a99-afc5-f33bd8148167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1800441423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8509e0bd-49f6-4ff8-b48a-89a79ac4c814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2de313c29d4d419c36a9be2189c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:48Z,use_quota=True,user_id='d4459b46c4ae476ba4d5510d5d1bd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec20b47-8725-458a-a938-4556727fddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec20b47-8725-458a-a938-4556727fddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac301274-b283-4098-a764-53844e9b1ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac301274-b283-4098-a764-53844e9b1ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8509e0bd-49f6-4ff8-b48a-89a79ac4c814', 'volume_name': 'volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058caba8-81c8-4719-8f5b-ecde58a05226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058caba8-81c8-4719-8f5b-ecde58a05226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6f2cfe-89ac-4181-9f45-47da935bd73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:48 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Volume 8509e0bd-49f6-4ff8-b48a-89a79ac4c814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814', 'volume_size': 1} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:48 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e" returned: 0 in 0.621s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:48 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e is being set with open permissions: ugo+rw Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:48 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e Apr 24 19:24:48 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:48 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e" returned: 0 in 0.431s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:48 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.info Apr 24 19:24:48 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:49 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.info" returned: 0 in 0.456s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:49 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.info is being set with open permissions: ugo+rw Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:49 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.info Apr 24 19:24:49 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:49 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.info" returned: 0 in 0.453s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.344s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.643s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1800441423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8509e0bd-49f6-4ff8-b48a-89a79ac4c814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2de313c29d4d419c36a9be2189c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:48Z,use_quota=True,user_id='d4459b46c4ae476ba4d5510d5d1bd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Creating volume 8509e0bd-49f6-4ff8-b48a-89a79ac4c814 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:49 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:24:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:49 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 1073741824 Apr 24 19:24:49 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:49 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-cf577bfc-2f8b-4d05-9ae1-56a0edf40d60 tempest-SnapshotDependencyTests-1344002524 None] Create snapshot completed successfully Apr 24 19:24:50 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 1073741824" returned: 0 in 0.631s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:50 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 Apr 24 19:24:50 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:50 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" returned: 0 in 0.460s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6f2cfe-89ac-4181-9f45-47da935bd73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71becf5-1ecd-43d1-a760-489084f100d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:50 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Volume volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 (8509e0bd-49f6-4ff8-b48a-89a79ac4c814): created successfully Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71becf5-1ecd-43d1-a760-489084f100d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Flow 'volume_create_manager' (d4c50fb3-7fda-40ea-a313-d412e1d83f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:50 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-faa76a4d-0cab-4bd0-bb07-fec420076f8b tempest-CinderUnicodeTest-220131027 None] Created volume successfully. Apr 24 19:24:50 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Flow 'volume_create_manager' (ca0c31a4-befe-42e2-be4b-75def5b3de20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159de662-c656-44c2-9c9e-f79a86bd1342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159de662-c656-44c2-9c9e-f79a86bd1342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4e18d8-4562-4323-901b-e13bee0c5123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026a0c9246114365900b46a8d64262ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0235bb9e-c789-4be6-9cd6-8743c0f6e07e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:51Z,use_quota=True,user_id='c82fab15babf45ee9745dc1caa33c43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0f9088-a28f-42bd-b42f-3c8f2f355991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0f9088-a28f-42bd-b42f-3c8f2f355991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4458216-1f4a-4436-9368-6df2e277ef86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4458216-1f4a-4436-9368-6df2e277ef86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d4e18d8-4562-4323-901b-e13bee0c5123', 'volume_name': 'volume-8d4e18d8-4562-4323-901b-e13bee0c5123', 'volume_size': 1, 'snapshot_id': '0235bb9e-c789-4be6-9cd6-8743c0f6e07e'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84cd478-2550-4d64-bb70-e0c2431bb312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84cd478-2550-4d64-bb70-e0c2431bb312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93882881-fafd-40b6-b10e-87fe17bf8c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Volume 8d4e18d8-4562-4323-901b-e13bee0c5123: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d4e18d8-4562-4323-901b-e13bee0c5123', 'volume_size': 1, 'snapshot_id': '0235bb9e-c789-4be6-9cd6-8743c0f6e07e'} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "cinder-quobyte-0235bb9e-c789-4be6-9cd6-8743c0f6e07e-8d4e18d8-4562-4323-901b-e13bee0c5123" by "_create_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-0235bb9e-c789-4be6-9cd6-8743c0f6e07e-8d4e18d8-4562-4323-901b-e13bee0c5123" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Creating volume 8d4e18d8-4562-4323-901b-e13bee0c5123 from snapshot 0235bb9e-c789-4be6-9cd6-8743c0f6e07e {{(pid=81522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "cinder-quobyte-8d4e18d8-4562-4323-901b-e13bee0c5123" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-8d4e18d8-4562-4323-901b-e13bee0c5123" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] snapshot: 0235bb9e-c789-4be6-9cd6-8743c0f6e07e, volume: 8d4e18d8-4562-4323-901b-e13bee0c5123, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efd44a1-5de9-4d04-861a-d3cc89dd1918]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:51 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e Apr 24 19:24:51 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:51 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e" returned: 0 in 0.541s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e983a812-475c-40e7-8fb7-fba0b6d863a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aed1ce7-ed90-4071-bc3a-a64f2b7478a9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:51 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 Apr 24 19:24:51 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:52 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5" returned: 0 in 0.527s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:52 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:24:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:52 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 Apr 24 19:24:52 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:56 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123" returned: 0 in 4.663s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:56 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cacc09-6704-4d4f-89dd-2dc02419c6f9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:57 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 Apr 24 19:24:57 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:57 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5" returned: 0 in 0.626s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:57 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:24:57 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Converted 1024.00 MB image at 219.55 MB/s Apr 24 19:24:57 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 is being set with open permissions: ugo+rw Apr 24 19:24:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:57 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 Apr 24 19:24:57 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:58 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123" returned: 0 in 0.418s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-8d4e18d8-4562-4323-901b-e13bee0c5123" released by "_copy_volume_from_snapshot" :: held 6.872s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-0235bb9e-c789-4be6-9cd6-8743c0f6e07e-8d4e18d8-4562-4323-901b-e13bee0c5123" released by "_create_volume_from_snapshot" :: held 6.905s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.921s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.491s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Creating offline snapshot c2fac9a9-987c-4f40-a566-d960d1228207 of volume 8509e0bd-49f6-4ff8-b48a-89a79ac4c814 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93882881-fafd-40b6-b10e-87fe17bf8c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4e18d8-4562-4323-901b-e13bee0c5123', 'volume_size': 1, 'snapshot_id': '0235bb9e-c789-4be6-9cd6-8743c0f6e07e'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d06e86c-c130-44e8-9e3b-4547efb1134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5d5104-7727-4ed6-8717-ff601d743a60]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:58 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Volume volume-8d4e18d8-4562-4323-901b-e13bee0c5123 (8d4e18d8-4562-4323-901b-e13bee0c5123): created successfully Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d06e86c-c130-44e8-9e3b-4547efb1134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Flow 'volume_create_manager' (ca0c31a4-befe-42e2-be4b-75def5b3de20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:58 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-55376450-9f9a-4bb5-b00d-7e75fa53f720 tempest-SnapshotDependencyTests-1344002524 None] Created volume successfully. Apr 24 19:24:58 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 Apr 24 19:24:58 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:58 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" returned: 0 in 0.517s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:58 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 1G Apr 24 19:24:58 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "cinder-0235bb9e-c789-4be6-9cd6-8743c0f6e07e-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-0235bb9e-c789-4be6-9cd6-8743c0f6e07e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "cinder-quobyte-e983a812-475c-40e7-8fb7-fba0b6d863a5" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-e983a812-475c-40e7-8fb7-fba0b6d863a5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "cinder-quobyte-0235bb9e-c789-4be6-9cd6-8743c0f6e07e" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-0235bb9e-c789-4be6-9cd6-8743c0f6e07e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Deleting offline snapshot 0235bb9e-c789-4be6-9cd6-8743c0f6e07e of volume e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] snapshot_file for this snap is: volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b5072-b64e-4d56-908a-66f641b77173]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:58 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e Apr 24 19:24:58 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:59 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 1G" returned: 0 in 0.681s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:59 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 Apr 24 19:24:59 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:59 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e" returned: 0 in 0.594s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:59 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e983a812-475c-40e7-8fb7-fba0b6d863a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:24:59 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[08541c14-1ea0-4a42-bc90-3e97d6d5121b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:59 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 Apr 24 19:24:59 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:59 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207" returned: 0 in 0.509s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:59 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 is being set with open permissions: ugo+rw Apr 24 19:24:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:59 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 Apr 24 19:24:59 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:00 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5" returned: 0 in 0.537s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:00 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e Apr 24 19:25:00 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:00 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207" returned: 0 in 0.477s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:00 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.info Apr 24 19:25:00 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:00 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e" returned: 0 in 0.527s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:00 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e Apr 24 19:25:00 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:00 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.info" returned: 0 in 0.486s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:00 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.info is being set with open permissions: ugo+rw Apr 24 19:25:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:00 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.info Apr 24 19:25:00 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:00 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5.0235bb9e-c789-4be6-9cd6-8743c0f6e07e" returned: 0 in 0.447s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-0235bb9e-c789-4be6-9cd6-8743c0f6e07e" released by "_delete_snapshot" :: held 2.211s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-e983a812-475c-40e7-8fb7-fba0b6d863a5" released by "delete_snapshot" :: held 2.239s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:01 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Created reservations ['e580fac1-c291-4d0e-b6c5-187d63b8cb6f', 'f41c6a65-5817-4fb5-95fa-2fcc5552a7b8', '76826db3-32c9-41ff-aacf-eabf6c5d75df', '4478f568-5f1f-4f55-9bfe-2f45ba3a7bd0'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:01 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Delete snapshot completed successfully. Apr 24 19:25:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-35ed42d6-1b24-486e-86a5-87ee265356ee tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-0235bb9e-c789-4be6-9cd6-8743c0f6e07e-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:01 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.info" returned: 0 in 0.511s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:01 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-396f73cb-b835-49e9-9fe8-9f8face803ec tempest-CinderUnicodeTest-220131027 None] Create snapshot completed successfully Apr 24 19:25:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "cinder-e983a812-475c-40e7-8fb7-fba0b6d863a5-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-e983a812-475c-40e7-8fb7-fba0b6d863a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "cinder-quobyte-e983a812-475c-40e7-8fb7-fba0b6d863a5" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-e983a812-475c-40e7-8fb7-fba0b6d863a5" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0509c529-c622-4811-b029-ce7954dca6e9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Acquiring lock "cinder-c2fac9a9-987c-4f40-a566-d960d1228207-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Lock "cinder-c2fac9a9-987c-4f40-a566-d960d1228207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Acquiring lock "cinder-quobyte-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Lock "cinder-quobyte-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Acquiring lock "cinder-quobyte-c2fac9a9-987c-4f40-a566-d960d1228207" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:02 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 Apr 24 19:25:02 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Lock "cinder-quobyte-c2fac9a9-987c-4f40-a566-d960d1228207" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Deleting offline snapshot c2fac9a9-987c-4f40-a566-d960d1228207 of volume 8509e0bd-49f6-4ff8-b48a-89a79ac4c814 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] snapshot_file for this snap is: volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[de753531-cfbe-474c-b8e2-62a2d950eac9]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:02 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 Apr 24 19:25:02 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:02 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5" returned: 0 in 0.553s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:02 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5 Apr 24 19:25:02 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:02 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207" returned: 0 in 0.533s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[de878432-fc8b-4499-9343-c1ab8717eb79]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:02 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 Apr 24 19:25:02 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:03 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e983a812-475c-40e7-8fb7-fba0b6d863a5" returned: 0 in 0.476s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-e983a812-475c-40e7-8fb7-fba0b6d863a5" released by "delete_volume" :: held 1.101s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Created reservations ['f8ca5a81-4c62-4247-a811-8066aee394c8', '6d46dabc-07ca-4eda-91c9-c81aa27cf2f6', '451ae2e9-cb83-4b38-b0c1-1bc774fc759d', 'edeb47a5-5971-406b-8724-bda706f0d8d1'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:03 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:03 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:03 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" returned: 0 in 0.573s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:03 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 Apr 24 19:25:03 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:03 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.439s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:03 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Deleted volume successfully. Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7243a4ea-02ba-47b5-8716-9e74a0ef8a52 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-e983a812-475c-40e7-8fb7-fba0b6d863a5-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:03 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207" returned: 0 in 0.545s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:03 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207 Apr 24 19:25:03 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "cinder-8d4e18d8-4562-4323-901b-e13bee0c5123-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-8d4e18d8-4562-4323-901b-e13bee0c5123-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "cinder-quobyte-8d4e18d8-4562-4323-901b-e13bee0c5123" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-8d4e18d8-4562-4323-901b-e13bee0c5123" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[250c9ed0-9040-4d9a-8f07-5269833a494e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:04 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 Apr 24 19:25:04 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:04 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814.c2fac9a9-987c-4f40-a566-d960d1228207" returned: 0 in 0.479s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Lock "cinder-quobyte-c2fac9a9-987c-4f40-a566-d960d1228207" released by "_delete_snapshot" :: held 2.236s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Lock "cinder-quobyte-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" released by "delete_snapshot" :: held 2.268s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Created reservations ['e1f736f6-3c53-429e-81e0-16c44038ee35', '420896c3-3ba2-490d-88e8-f8b5d249ba7b', '33a19fe5-87ef-4348-93db-443681155b93', '625e7899-de6a-4485-8a88-ad8b9f75459d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:04 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Delete snapshot completed successfully. Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-fe05d411-ef07-4d22-8981-1f1a6fd5fdda tempest-CinderUnicodeTest-220131027 None] Lock "cinder-c2fac9a9-987c-4f40-a566-d960d1228207-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:04 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123" returned: 0 in 0.540s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:04 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123 Apr 24 19:25:04 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:05 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8d4e18d8-4562-4323-901b-e13bee0c5123" returned: 0 in 0.442s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-quobyte-8d4e18d8-4562-4323-901b-e13bee0c5123" released by "delete_volume" :: held 1.033s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Acquiring lock "cinder-8509e0bd-49f6-4ff8-b48a-89a79ac4c814-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Created reservations ['0b3415b3-1c7c-44c3-b89f-611be3987b20', 'e72b9443-c3d0-46ab-b887-95ce158efcf7', '90d2f372-c8b8-4b24-b6e1-f9d1879be17c', 'c6a72c47-e435-404b-8200-f05b99cfd657'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Lock "cinder-8509e0bd-49f6-4ff8-b48a-89a79ac4c814-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Acquiring lock "cinder-quobyte-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Lock "cinder-quobyte-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cf42c2-39bf-4148-be7a-3fb2445187b7]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:05 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:05 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:05 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 Apr 24 19:25:05 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:05 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.479s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:05 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:05 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Deleted volume successfully. Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-7c125733-24c8-41ee-b8d4-ce7d23aae7a5 tempest-SnapshotDependencyTests-1344002524 None] Lock "cinder-8d4e18d8-4562-4323-901b-e13bee0c5123-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:06 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" returned: 0 in 0.548s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:06 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814 Apr 24 19:25:06 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:06 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" returned: 0 in 0.499s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Lock "cinder-quobyte-8509e0bd-49f6-4ff8-b48a-89a79ac4c814" released by "delete_volume" :: held 1.112s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Created reservations ['3c71dc7d-99e1-4dec-9922-efdfeb9b1417', '4b0e37f1-18f8-4107-a5b9-2ed644399470', '0d8c2c7c-b3fa-4a6a-a95c-5d0436f08d4e', 'a07229be-efbe-482d-8f18-30be22c465d9'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:06 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:06 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:07 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.532s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:07 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:07 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Deleted volume successfully. Apr 24 19:25:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-86ff1a40-52ae-43e8-9f4c-00f1a2bd4e4e tempest-CinderUnicodeTest-220131027 None] Lock "cinder-8509e0bd-49f6-4ff8-b48a-89a79ac4c814-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Acquiring lock "cinder-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Lock "cinder-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Acquiring lock "cinder-quobyte-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Lock "cinder-quobyte-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4" acquired by "delete_volume" :: waited 0.037s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:07 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab8d17f-37bd-4b5f-af36-941ca29ab10d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:07 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 Apr 24 19:25:07 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:08 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4" returned: 0 in 0.630s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:08 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4 Apr 24 19:25:08 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:08 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4" returned: 0 in 0.504s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Lock "cinder-quobyte-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4" released by "delete_volume" :: held 1.188s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Created reservations ['a2b0a04c-118f-4a1d-828d-1a0d5f228b4c', 'a07103db-48ae-4be7-920c-f8d3c9d5701b', '25594b9e-3b56-4d98-bddb-78578e72a031', '96399cb0-563b-4e7f-a778-da7e7e9c2574'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:09 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:09 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:09 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.498s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:09 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Deleted volume successfully. Apr 24 19:25:09 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e9765a58-52e4-4996-a178-f5214d69feaa tempest-CinderUnicodeTest-220131027 None] Lock "cinder-6e5517f7-38f3-4fbd-95d6-6b50a7912ba4-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:19 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=51,cinder:UPDATE=70,cinder:INSERT=15,cinder:DELETE=4 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:25:19 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=52,cinder:INSERT=18,cinder:UPDATE=60,cinder:DELETE=7 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:25:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:25:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:21 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:21 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:21 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.509s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:21 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (90f47742-bf11-43c1-b3e5-d1bc8aea22d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ffc48f-0969-47fa-a6ce-cb66f518fd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Flow 'volume_create_manager' (6a63665c-0223-4808-8dc7-0abe94bbda7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df38d4a-3f1c-4949-b4ce-f7f47e3b6bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ffc48f-0969-47fa-a6ce-cb66f518fd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-228251315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a62538a-5713-415e-8c6a-a46e22c4eb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:24Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d80f04-83bb-4f94-a224-0544b4e3e9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d80f04-83bb-4f94-a224-0544b4e3e9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffedac2f-9d66-4b21-b339-308eb0b685a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffedac2f-9d66-4b21-b339-308eb0b685a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a62538a-5713-415e-8c6a-a46e22c4eb5e', 'volume_name': 'volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac9871f-59da-4504-8ad8-40a4d75027bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac9871f-59da-4504-8ad8-40a4d75027bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b2b4c0-b702-4e16-9404-b70f8e85888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume 1a62538a-5713-415e-8c6a-a46e22c4eb5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e', 'volume_size': 1} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-228251315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a62538a-5713-415e-8c6a-a46e22c4eb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:24Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Creating volume 1a62538a-5713-415e-8c6a-a46e22c4eb5e {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:24 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df38d4a-3f1c-4949-b4ce-f7f47e3b6bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1116505267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90853384-7991-492b-80a6-535ad0a46960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a5eb3dc8184a1f90842e151d1efaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:24Z,use_quota=True,user_id='4d54c538a85441e38839c5ae8b24f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db354371-0f72-4982-beac-7b50837e4b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db354371-0f72-4982-beac-7b50837e4b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e 1073741824 Apr 24 19:25:24 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bd9296-3d48-4879-bb2e-abb7142076b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bd9296-3d48-4879-bb2e-abb7142076b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90853384-7991-492b-80a6-535ad0a46960', 'volume_name': 'volume-90853384-7991-492b-80a6-535ad0a46960', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34300d18-695e-4304-8490-c0f933915a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34300d18-695e-4304-8490-c0f933915a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba7cc98-5bfc-4000-a63c-f09ccc853cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Volume 90853384-7991-492b-80a6-535ad0a46960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90853384-7991-492b-80a6-535ad0a46960', 'volume_size': 1} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (fee0b878-7487-4a70-841d-3b65c691272c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b961ed-a66e-4351-bf8e-31e73738a57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b961ed-a66e-4351-bf8e-31e73738a57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87612418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f958fa-759a-4ffa-9879-0368a49e0b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:25Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af2c9b0-179c-4498-8f39-8cefecba7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af2c9b0-179c-4498-8f39-8cefecba7d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddb5891-2cc4-4e1e-8a6e-3ba803c5082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddb5891-2cc4-4e1e-8a6e-3ba803c5082b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f958fa-759a-4ffa-9879-0368a49e0b42', 'volume_name': 'volume-96f958fa-759a-4ffa-9879-0368a49e0b42', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df805a2f-241e-4ad1-9018-b74dbe259075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df805a2f-241e-4ad1-9018-b74dbe259075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6908984c-b366-4fbf-a097-5cfdf20552d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Volume 96f958fa-759a-4ffa-9879-0368a49e0b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f958fa-759a-4ffa-9879-0368a49e0b42', 'volume_size': 1} Apr 24 19:25:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (49dd5600-b01c-45e9-a7b0-46946d0844bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446cf249-451c-49de-873f-26647fadfcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446cf249-451c-49de-873f-26647fadfcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1620284365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7f87fd-1e39-409b-8810-876989a988c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:25Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fa50b8-787e-4d8a-8ffb-7f53464f1fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fa50b8-787e-4d8a-8ffb-7f53464f1fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f543a9cf-28b5-4fa1-b689-c93d03ccbe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f543a9cf-28b5-4fa1-b689-c93d03ccbe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7f87fd-1e39-409b-8810-876989a988c9', 'volume_name': 'volume-ce7f87fd-1e39-409b-8810-876989a988c9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef047e68-984e-4907-9d5e-a4f04feee1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef047e68-984e-4907-9d5e-a4f04feee1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fdf25b-4341-4e76-a883-14aa5cad6561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Volume ce7f87fd-1e39-409b-8810-876989a988c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7f87fd-1e39-409b-8810-876989a988c9', 'volume_size': 1} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (0e16b549-1f34-43d6-a284-545836b69d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bfc0f1-25d9-4adf-be3b-cea1ddb71161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bfc0f1-25d9-4adf-be3b-cea1ddb71161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915297143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef97ad1a-2164-41d1-9347-a6e6fecd16d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:26Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d8d637-07f5-479f-a05a-2fb4ca0c453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d8d637-07f5-479f-a05a-2fb4ca0c453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efebe0f8-bb2e-4f71-b2db-d417010d46b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efebe0f8-bb2e-4f71-b2db-d417010d46b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef97ad1a-2164-41d1-9347-a6e6fecd16d3', 'volume_name': 'volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df8ccb7-baeb-4308-8dba-1869c05f4114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df8ccb7-baeb-4308-8dba-1869c05f4114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e07accb-d2f4-40c5-8c69-c5480506da9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Volume ef97ad1a-2164-41d1-9347-a6e6fecd16d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3', 'volume_size': 1} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e 1073741824" returned: 0 in 1.094s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e Apr 24 19:25:25 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (3e60447d-17e4-4b1f-8837-3a376cc6fc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd6a0e1-b35a-42a5-bb3e-61a7dfda39f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd6a0e1-b35a-42a5-bb3e-61a7dfda39f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-177581909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaf5729-dda1-44d4-9769-eae30ac60db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:26Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00022b00-449b-48cb-8a82-4fe50cb7d3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00022b00-449b-48cb-8a82-4fe50cb7d3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587b7094-38f5-45bf-a110-bae17418d5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587b7094-38f5-45bf-a110-bae17418d5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aaf5729-dda1-44d4-9769-eae30ac60db7', 'volume_name': 'volume-3aaf5729-dda1-44d4-9769-eae30ac60db7', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a120196-36d9-4f58-b5b3-1fc0425a7dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a120196-36d9-4f58-b5b3-1fc0425a7dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:25 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d70deff-5e50-4960-a4d3-0b984ab2d1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Volume 3aaf5729-dda1-44d4-9769-eae30ac60db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aaf5729-dda1-44d4-9769-eae30ac60db7', 'volume_size': 1} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:26 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (395ad37a-9fb6-44aa-8f6b-e97a16678d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264e304e-c487-4eb0-801d-2197abf477ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e" returned: 0 in 0.590s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1116505267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90853384-7991-492b-80a6-535ad0a46960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a5eb3dc8184a1f90842e151d1efaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:24Z,use_quota=True,user_id='4d54c538a85441e38839c5ae8b24f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Creating volume 90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:26 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264e304e-c487-4eb0-801d-2197abf477ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-579267933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc53761-c070-4c4f-b35f-e7bc13a39627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:26Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16ac6dc-df30-42c1-a05f-747d28890b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 1073741824 Apr 24 19:25:26 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16ac6dc-df30-42c1-a05f-747d28890b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988dc82d-d359-48ce-b156-e3a96b485e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988dc82d-d359-48ce-b156-e3a96b485e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc53761-c070-4c4f-b35f-e7bc13a39627', 'volume_name': 'volume-9dc53761-c070-4c4f-b35f-e7bc13a39627', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3966a23-c687-43d3-94a5-978b0b247b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3966a23-c687-43d3-94a5-978b0b247b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3db1f2-8f77-444c-a48e-cdb7b63958a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Volume 9dc53761-c070-4c4f-b35f-e7bc13a39627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc53761-c070-4c4f-b35f-e7bc13a39627', 'volume_size': 1} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b2b4c0-b702-4e16-9404-b70f8e85888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd826023-fbbc-4fa2-86e0-1757e4c80e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e (1a62538a-5713-415e-8c6a-a46e22c4eb5e): created successfully Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd826023-fbbc-4fa2-86e0-1757e4c80e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (90f47742-bf11-43c1-b3e5-d1bc8aea22d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:26 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ff23f01e-0625-48c7-a2db-9be879e3fc77 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created volume successfully. Apr 24 19:25:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:27 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 1073741824" returned: 0 in 0.840s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:27 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 Apr 24 19:25:27 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:27 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960" returned: 0 in 0.639s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.036s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87612418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f958fa-759a-4ffa-9879-0368a49e0b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:25Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Creating volume 96f958fa-759a-4ffa-9879-0368a49e0b42 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:27 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:27 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42 1073741824 Apr 24 19:25:27 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba7cc98-5bfc-4000-a63c-f09ccc853cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90853384-7991-492b-80a6-535ad0a46960', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ab96b5-c7aa-451c-8f2f-2492dc39c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:28 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Volume volume-90853384-7991-492b-80a6-535ad0a46960 (90853384-7991-492b-80a6-535ad0a46960): created successfully Apr 24 19:25:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ab96b5-c7aa-451c-8f2f-2492dc39c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:28 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Flow 'volume_create_manager' (6a63665c-0223-4808-8dc7-0abe94bbda7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:28 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7af223c9-85df-4a44-921d-2ed8f5ca2d90 tempest-VolumeDependencyTests-1595374147 None] Created volume successfully. Apr 24 19:25:28 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42 1073741824" returned: 0 in 0.715s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:28 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42 Apr 24 19:25:28 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:29 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42" returned: 0 in 0.797s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.182s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1620284365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7f87fd-1e39-409b-8810-876989a988c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:25Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Creating volume ce7f87fd-1e39-409b-8810-876989a988c9 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:29 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:29 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9 1073741824 Apr 24 19:25:29 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6908984c-b366-4fbf-a097-5cfdf20552d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f958fa-759a-4ffa-9879-0368a49e0b42', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1d4f04-c05b-4d15-bb09-54cf0a5fbc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:29 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Volume volume-96f958fa-759a-4ffa-9879-0368a49e0b42 (96f958fa-759a-4ffa-9879-0368a49e0b42): created successfully Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1d4f04-c05b-4d15-bb09-54cf0a5fbc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:29 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (fee0b878-7487-4a70-841d-3b65c691272c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:29 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-39cb9d96-2a69-49f4-945a-ec03d7700acd tempest-CreateVolumesFromImageTest-234258556 None] Created volume successfully. Apr 24 19:25:30 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9 1073741824" returned: 0 in 0.697s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:30 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9 Apr 24 19:25:30 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:30 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9" returned: 0 in 0.500s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.991s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915297143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef97ad1a-2164-41d1-9347-a6e6fecd16d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:26Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Creating volume ef97ad1a-2164-41d1-9347-a6e6fecd16d3 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:30 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fdf25b-4341-4e76-a883-14aa5cad6561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7f87fd-1e39-409b-8810-876989a988c9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d90afb-d591-4a7b-8a4b-c640e91f3c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:30 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 1073741824 Apr 24 19:25:30 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Volume volume-ce7f87fd-1e39-409b-8810-876989a988c9 (ce7f87fd-1e39-409b-8810-876989a988c9): created successfully Apr 24 19:25:30 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d90afb-d591-4a7b-8a4b-c640e91f3c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:30 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (49dd5600-b01c-45e9-a7b0-46946d0844bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:30 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-be304ab1-8a07-4c68-bc1f-75a96c2139c2 tempest-CreateVolumesFromImageTest-234258556 None] Created volume successfully. Apr 24 19:25:31 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 1073741824" returned: 0 in 0.797s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:31 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 Apr 24 19:25:31 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:32 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3" returned: 0 in 0.590s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.089s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-177581909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaf5729-dda1-44d4-9769-eae30ac60db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:26Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Creating volume 3aaf5729-dda1-44d4-9769-eae30ac60db7 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:32 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:32 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 1073741824 Apr 24 19:25:32 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e07accb-d2f4-40c5-8c69-c5480506da9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0adf368-b211-41c2-954f-90dd20298da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:32 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Volume volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 (ef97ad1a-2164-41d1-9347-a6e6fecd16d3): created successfully Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0adf368-b211-41c2-954f-90dd20298da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (0e16b549-1f34-43d6-a284-545836b69d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:32 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-b6ace6ed-5468-459f-bd01-3ec12c669d0a tempest-CreateVolumesFromImageTest-234258556 None] Created volume successfully. Apr 24 19:25:32 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 1073741824" returned: 0 in 0.873s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:33 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 Apr 24 19:25:33 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:33 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7" returned: 0 in 0.505s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.140s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-579267933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc53761-c070-4c4f-b35f-e7bc13a39627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc560bc3b74df8b77fdebfeb5df935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:26Z,use_quota=True,user_id='30fbf45ce7544a30b617010304a5bc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Creating volume 9dc53761-c070-4c4f-b35f-e7bc13a39627 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:33 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:33 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 1073741824 Apr 24 19:25:33 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d70deff-5e50-4960-a4d3-0b984ab2d1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aaf5729-dda1-44d4-9769-eae30ac60db7', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d72b958-e4df-49b9-88c2-1dffb1c32552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:33 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Volume volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 (3aaf5729-dda1-44d4-9769-eae30ac60db7): created successfully Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d72b958-e4df-49b9-88c2-1dffb1c32552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:33 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (3e60447d-17e4-4b1f-8837-3a376cc6fc44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:33 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7b844eff-f71d-48c5-8f02-7502f2b5d0c9 tempest-CreateVolumesFromImageTest-234258556 None] Created volume successfully. Apr 24 19:25:34 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 1073741824" returned: 0 in 0.825s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:34 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 Apr 24 19:25:34 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:34 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627" returned: 0 in 0.530s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.158s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3db1f2-8f77-444c-a48e-cdb7b63958a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc53761-c070-4c4f-b35f-e7bc13a39627', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d1d7f0-e87c-4596-98f0-492fa5628144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Creating offline snapshot 201b4296-46ae-4b94-821a-e3d9bf817793 of volume 1a62538a-5713-415e-8c6a-a46e22c4eb5e {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:34 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Volume volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 (9dc53761-c070-4c4f-b35f-e7bc13a39627): created successfully Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d1d7f0-e87c-4596-98f0-492fa5628144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:34 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Flow 'volume_create_manager' (395ad37a-9fb6-44aa-8f6b-e97a16678d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8031c1ce-e36b-4a84-97ef-812c42304c84]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:35 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a90f6b0e-2d83-4e1c-ba49-f972074f4612 tempest-CreateVolumesFromImageTest-234258556 None] Created volume successfully. Apr 24 19:25:35 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e Apr 24 19:25:35 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-9dc53761-c070-4c4f-b35f-e7bc13a39627-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-9dc53761-c070-4c4f-b35f-e7bc13a39627-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-quobyte-9dc53761-c070-4c4f-b35f-e7bc13a39627" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-9dc53761-c070-4c4f-b35f-e7bc13a39627" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42659b2-45f2-4ca2-9b0a-8fa4d4013b46]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:35 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 Apr 24 19:25:35 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:35 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e" returned: 0 in 0.784s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:35 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 1G Apr 24 19:25:35 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:36 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627" returned: 0 in 0.761s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:36 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627 Apr 24 19:25:36 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:36 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 1G" returned: 0 in 0.826s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:36 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 Apr 24 19:25:36 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:36 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9dc53761-c070-4c4f-b35f-e7bc13a39627" returned: 0 in 0.644s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-9dc53761-c070-4c4f-b35f-e7bc13a39627" released by "delete_volume" :: held 1.468s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Created reservations ['f51d62ad-17b2-420e-bcda-5af0f1cb8f9c', 'f2e8b14f-6973-469f-8ff0-be15cc9edaa7', '0e542cbf-c223-44ac-bdae-b3bcba212bb6', '2b6a16c3-da5d-43dc-81ad-a9655ca1f0b5'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:36 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:36 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:37 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793" returned: 0 in 0.640s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:37 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 is being set with open permissions: ugo+rw Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:37 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 Apr 24 19:25:37 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-3aaf5729-dda1-44d4-9769-eae30ac60db7-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-3aaf5729-dda1-44d4-9769-eae30ac60db7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:37 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.683s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:37 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Deleted volume successfully. Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-quobyte-3aaf5729-dda1-44d4-9769-eae30ac60db7" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ab546a3c-120c-4d69-ad0b-4968cb642a97 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-9dc53761-c070-4c4f-b35f-e7bc13a39627-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-3aaf5729-dda1-44d4-9769-eae30ac60db7" acquired by "delete_volume" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9819d0-b582-4246-802c-f4e4956686b5]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:37 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 Apr 24 19:25:37 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:37 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793" returned: 0 in 0.638s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:38 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.info Apr 24 19:25:38 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:38 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7" returned: 0 in 0.810s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:38 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7 Apr 24 19:25:38 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:38 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.info" returned: 0 in 0.644s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:38 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.info is being set with open permissions: ugo+rw Apr 24 19:25:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:38 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.info Apr 24 19:25:38 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:39 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.info" returned: 0 in 0.524s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.135s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Creating offline snapshot d6906ff1-7b58-451f-9d69-86143573c75e of volume 90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:39 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3aaf5729-dda1-44d4-9769-eae30ac60db7" returned: 0 in 0.668s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b937d488-9c52-4290-a65c-be05a1a21393]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:39 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-605665f6-dd00-4d22-b46f-8c80cd4c4ad8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Create snapshot completed successfully Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-3aaf5729-dda1-44d4-9769-eae30ac60db7" released by "delete_volume" :: held 1.551s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Created reservations ['2d1e8075-ad41-43d9-8d41-9e00686d1047', '1a6dfbfd-ad2b-4e92-9c1f-51fdbc7eda73', 'befd97fe-9dc2-48ed-bd82-51f75d605d2b', '7da7f13b-7731-4be8-b222-b93184375f4b'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:39 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 Apr 24 19:25:39 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:39 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:39 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (673dd7f7-62fb-4676-bb7c-a194920688ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372020bf-07d9-4ade-81ad-996fec6d53b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-ef97ad1a-2164-41d1-9347-a6e6fecd16d3-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372020bf-07d9-4ade-81ad-996fec6d53b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-260498555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81360f4-e7d4-4db5-8c9f-a10019b7a555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:40Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1423dc64-d459-4a12-a642-32f2d8f1236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1423dc64-d459-4a12-a642-32f2d8f1236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1246f088-6da3-43b5-95b5-39e5aebe038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:39 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1246f088-6da3-43b5-95b5-39e5aebe038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81360f4-e7d4-4db5-8c9f-a10019b7a555', 'volume_name': 'volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b3e580-123f-44b5-81ba-04d4f0c13160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b3e580-123f-44b5-81ba-04d4f0c13160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab10b4d6-7414-4e0d-b8ef-89b9071823a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume f81360f4-e7d4-4db5-8c9f-a10019b7a555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555', 'volume_size': 1} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-ef97ad1a-2164-41d1-9347-a6e6fecd16d3-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-quobyte-ef97ad1a-2164-41d1-9347-a6e6fecd16d3" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-ef97ad1a-2164-41d1-9347-a6e6fecd16d3" acquired by "delete_volume" :: waited 0.047s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6130439-75a5-4117-a625-6c58d724c1a6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:40 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (c98a4b5d-601a-4763-a7ac-51718b74dff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06d1219-eb77-430f-945e-84d001459f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 Apr 24 19:25:40 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960" returned: 0 in 1.111s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:40 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.946s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06d1219-eb77-430f-945e-84d001459f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-513557700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfbcd5d-352d-4687-917a-0e0f17c74afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:40Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c946bf5f-0730-4ccd-899f-41bd0e499f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c946bf5f-0730-4ccd-899f-41bd0e499f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a58308-b3d5-40a7-bde9-a56ba02a3ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a58308-b3d5-40a7-bde9-a56ba02a3ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cfbcd5d-352d-4687-917a-0e0f17c74afd', 'volume_name': 'volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee8e86-745b-4ca8-99f9-444a11b137bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee8e86-745b-4ca8-99f9-444a11b137bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e309eb2-e9ea-4d3a-b549-faaef59a5462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume 8cfbcd5d-352d-4687-917a-0e0f17c74afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd', 'volume_size': 1} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:40 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Deleted volume successfully. Apr 24 19:25:40 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e 1G Apr 24 19:25:40 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-d997bd76-7455-4fe2-a96d-ab8073e24fd5 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-3aaf5729-dda1-44d4-9769-eae30ac60db7-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (1b461a9f-dbba-4fd4-bb93-73bc4aa70698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf5d70f-a45f-467c-9abb-16adb951a430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf5d70f-a45f-467c-9abb-16adb951a430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343523937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45addca-7b3b-45f5-9e5f-651f3e9c49c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:41Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e1974a-32ea-47dc-b53f-223a7fa563dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e1974a-32ea-47dc-b53f-223a7fa563dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dad74d-1417-44c0-97e0-aff421fbe76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dad74d-1417-44c0-97e0-aff421fbe76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e45addca-7b3b-45f5-9e5f-651f3e9c49c3', 'volume_name': 'volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95e97ac-3225-48ad-b553-fe1d914957a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95e97ac-3225-48ad-b553-fe1d914957a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dfb0adf-ff06-4364-9c52-ae457bda2f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume e45addca-7b3b-45f5-9e5f-651f3e9c49c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3', 'volume_size': 1} Apr 24 19:25:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:41 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3" returned: 0 in 0.972s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:41 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3 Apr 24 19:25:41 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (6893b786-aaab-4b51-9cc4-1abacaed1f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f274ee-6fe9-400f-b852-66d2380c3347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e 1G" returned: 0 in 1.159s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90853384-7991-492b-80a6-535ad0a46960 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f274ee-6fe9-400f-b852-66d2380c3347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836540025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e14b63d-70ad-4e0e-be9a-765ae8e1988c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:41Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ba0ad2-b93a-42ac-9c06-18b37ea73404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ba0ad2-b93a-42ac-9c06-18b37ea73404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3a4f07-e181-4309-bc52-beabfa0d7033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3a4f07-e181-4309-bc52-beabfa0d7033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e14b63d-70ad-4e0e-be9a-765ae8e1988c', 'volume_name': 'volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90853384-7991-492b-80a6-535ad0a46960 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e Apr 24 19:25:41 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbe9811-e5f8-44e3-9f59-e1b15594ec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbe9811-e5f8-44e3-9f59-e1b15594ec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2c89ff-5da8-4c0b-83b8-213f67fad844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume 7e14b63d-70ad-4e0e-be9a-765ae8e1988c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c', 'volume_size': 1} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (8a4d8f31-6083-4251-853b-cfd516d6f534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ff0c17-6724-4cd9-8452-886af4083f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ff0c17-6724-4cd9-8452-886af4083f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-153512031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07593364-e88a-4065-b8d0-be678edb8bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:42Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb40ef30-ab40-464d-b0af-2abdd3f8e3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb40ef30-ab40-464d-b0af-2abdd3f8e3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867db695-8db3-4723-818f-22d7cbcf6815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867db695-8db3-4723-818f-22d7cbcf6815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07593364-e88a-4065-b8d0-be678edb8bcb', 'volume_name': 'volume-07593364-e88a-4065-b8d0-be678edb8bcb', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f45127-bddc-4e42-be36-6f2a2dc8434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f45127-bddc-4e42-be36-6f2a2dc8434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a034fc-3478-45e5-aa74-329315a05c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume 07593364-e88a-4065-b8d0-be678edb8bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07593364-e88a-4065-b8d0-be678edb8bcb', 'volume_size': 1} Apr 24 19:25:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:42 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ef97ad1a-2164-41d1-9347-a6e6fecd16d3" returned: 0 in 0.865s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-ef97ad1a-2164-41d1-9347-a6e6fecd16d3" released by "delete_volume" :: held 1.908s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Created reservations ['910dde0c-284c-4bf0-a2b9-e8f5599060dc', '1ab57852-9a8d-4669-af4c-5d9ecb86bd65', '1bb6bd23-7bfc-4cd7-955a-a0c660b86c7e', '4cd74da1-41a6-4f41-a25b-2ea54397b794'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:42 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90853384-7991-492b-80a6-535ad0a46960 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e" returned: 0 in 0.687s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:42 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e is being set with open permissions: ugo+rw Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:42 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e Apr 24 19:25:42 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:42 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:42 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-ce7f87fd-1e39-409b-8810-876989a988c9-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-ce7f87fd-1e39-409b-8810-876989a988c9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-quobyte-ce7f87fd-1e39-409b-8810-876989a988c9" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-ce7f87fd-1e39-409b-8810-876989a988c9" acquired by "delete_volume" :: waited 0.027s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fe9f8b-38a4-423e-bd5a-5eee8f888b25]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:42 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9 Apr 24 19:25:42 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:42 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e" returned: 0 in 0.681s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:42 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:42 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.info Apr 24 19:25:42 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.690s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:42 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:42 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Deleted volume successfully. Apr 24 19:25:43 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-62dbae4e-4af8-444b-9e07-f27dea07dc8a tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-ef97ad1a-2164-41d1-9347-a6e6fecd16d3-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:43 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9" returned: 0 in 0.698s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:43 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9 Apr 24 19:25:43 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:43 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.info" returned: 0 in 0.599s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:43 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.info is being set with open permissions: ugo+rw Apr 24 19:25:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:43 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.info Apr 24 19:25:43 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:44 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-ce7f87fd-1e39-409b-8810-876989a988c9" returned: 0 in 0.939s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-ce7f87fd-1e39-409b-8810-876989a988c9" released by "delete_volume" :: held 1.705s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:44 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.info" returned: 0 in 0.724s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.083s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.203s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-260498555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81360f4-e7d4-4db5-8c9f-a10019b7a555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:40Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Creating volume f81360f4-e7d4-4db5-8c9f-a10019b7a555 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:44 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:44 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 1073741824 Apr 24 19:25:44 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:44 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-1066343f-f2a1-4ad2-b21d-d2274673e968 tempest-VolumeDependencyTests-1595374147 None] Create snapshot completed successfully Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Created reservations ['ecb5694e-462b-492b-a29b-4273f63782de', '6b8bece9-16e2-4cdc-973d-0c05a4446c8a', '5d2c712c-09a0-462b-8ba8-2d90470e5bf9', '7fdf5e2e-70ca-4521-8f01-9ba18ee107c4'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:44 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:44 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-96f958fa-759a-4ffa-9879-0368a49e0b42-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-96f958fa-759a-4ffa-9879-0368a49e0b42-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "cinder-quobyte-96f958fa-759a-4ffa-9879-0368a49e0b42" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-96f958fa-759a-4ffa-9879-0368a49e0b42" acquired by "delete_volume" :: waited 0.045s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fb0cc0-920e-444e-b560-321c4b31243c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:45 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42 Apr 24 19:25:45 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:45 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.840s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:45 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Deleted volume successfully. Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-817344cd-28fc-426d-8976-4f3192e6b640 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-ce7f87fd-1e39-409b-8810-876989a988c9-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:45 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 1073741824" returned: 0 in 1.252s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:45 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 Apr 24 19:25:45 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Flow 'volume_create_manager' (be3d5437-d216-4d83-89cb-2d240e508197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4da4662-e25a-4a21-ab52-c8f985a697cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4da4662-e25a-4a21-ab52-c8f985a697cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-609438994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51500a6-2b35-4f55-b945-b04cadeb7b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a5eb3dc8184a1f90842e151d1efaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d6906ff1-7b58-451f-9d69-86143573c75e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:46Z,use_quota=True,user_id='4d54c538a85441e38839c5ae8b24f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9372bca4-cc59-481b-8e73-ab054426be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9372bca4-cc59-481b-8e73-ab054426be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb851ada-97fd-48da-80b4-1b11886f6dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb851ada-97fd-48da-80b4-1b11886f6dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e51500a6-2b35-4f55-b945-b04cadeb7b51', 'volume_name': 'volume-e51500a6-2b35-4f55-b945-b04cadeb7b51', 'volume_size': 1, 'snapshot_id': 'd6906ff1-7b58-451f-9d69-86143573c75e'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0eba90-8609-47e1-b888-6bf489989d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0eba90-8609-47e1-b888-6bf489989d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd3fce2-492b-475f-b832-1de0962e4f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:45 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Volume e51500a6-2b35-4f55-b945-b04cadeb7b51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e51500a6-2b35-4f55-b945-b04cadeb7b51', 'volume_size': 1, 'snapshot_id': 'd6906ff1-7b58-451f-9d69-86143573c75e'} Apr 24 19:25:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:46 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42" returned: 0 in 0.987s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:46 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42 Apr 24 19:25:46 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:46 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555" returned: 0 in 0.733s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.906s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-513557700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfbcd5d-352d-4687-917a-0e0f17c74afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:40Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Creating volume 8cfbcd5d-352d-4687-917a-0e0f17c74afd {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:46 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab10b4d6-7414-4e0d-b8ef-89b9071823a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05242712-e055-4375-a9b3-83e59ba3b1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:46 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd 1073741824 Apr 24 19:25:46 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:46 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 (f81360f4-e7d4-4db5-8c9f-a10019b7a555): created successfully Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05242712-e055-4375-a9b3-83e59ba3b1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (673dd7f7-62fb-4676-bb7c-a194920688ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:46 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-10c276ac-67ba-4339-aec5-979b9ff45402 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created volume successfully. Apr 24 19:25:46 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-96f958fa-759a-4ffa-9879-0368a49e0b42" returned: 0 in 0.659s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-quobyte-96f958fa-759a-4ffa-9879-0368a49e0b42" released by "delete_volume" :: held 1.707s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Created reservations ['207393e4-0c01-4792-99d0-98735932fed2', '6f37e1d6-c0cd-42e8-b9cc-d3a2f19064a2', 'fc92ac36-e32f-4646-831d-5efa5abb279a', 'efcd13aa-cf6c-484c-9c39-d9c37fc1694f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:46 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:46 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:47 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd 1073741824" returned: 0 in 1.060s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:47 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd Apr 24 19:25:47 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:47 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.788s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:47 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:47 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Deleted volume successfully. Apr 24 19:25:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-0bb3bc44-274b-4b6e-9c9b-5b8c67589251 tempest-CreateVolumesFromImageTest-234258556 None] Lock "cinder-96f958fa-759a-4ffa-9879-0368a49e0b42-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:48 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd" returned: 0 in 0.702s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.182s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343523937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45addca-7b3b-45f5-9e5f-651f3e9c49c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:41Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Creating volume e45addca-7b3b-45f5-9e5f-651f3e9c49c3 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:48 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e309eb2-e9ea-4d3a-b549-faaef59a5462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532119ed-4009-493a-9503-fbff582fc10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:48 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 1073741824 Apr 24 19:25:48 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:48 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd (8cfbcd5d-352d-4687-917a-0e0f17c74afd): created successfully Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532119ed-4009-493a-9503-fbff582fc10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:48 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (c98a4b5d-601a-4763-a7ac-51718b74dff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:48 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4f29d497-3e5d-42a7-a62e-c3d569f01adb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created volume successfully. Apr 24 19:25:49 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 1073741824" returned: 0 in 0.939s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:49 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 Apr 24 19:25:49 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:49 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3" returned: 0 in 0.753s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.312s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836540025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e14b63d-70ad-4e0e-be9a-765ae8e1988c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:41Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Creating volume 7e14b63d-70ad-4e0e-be9a-765ae8e1988c {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:49 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dfb0adf-ff06-4364-9c52-ae457bda2f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9876f3e4-6146-4eb7-b6de-3a2c59871278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:49 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 (e45addca-7b3b-45f5-9e5f-651f3e9c49c3): created successfully Apr 24 19:25:49 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c 1073741824 Apr 24 19:25:49 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9876f3e4-6146-4eb7-b6de-3a2c59871278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:49 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (1b461a9f-dbba-4fd4-bb93-73bc4aa70698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:49 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-698a7c7b-651d-4f1f-8f1c-16497f77a5eb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created volume successfully. Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (c059b5b2-57a1-44ef-91a8-5ede32503599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5abcd4-c327-4d59-ba45-d701e66ecbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5abcd4-c327-4d59-ba45-d701e66ecbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1498412520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9135cebe-8f57-4553-878b-0e1e05c58ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a758bc-9a76-4dbd-89cd-f49f67ebfeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a758bc-9a76-4dbd-89cd-f49f67ebfeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701e5a42-ed30-40c5-be6a-6709fe09e6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701e5a42-ed30-40c5-be6a-6709fe09e6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9135cebe-8f57-4553-878b-0e1e05c58ca7', 'volume_name': 'volume-9135cebe-8f57-4553-878b-0e1e05c58ca7', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29754eda-625a-4751-b83b-6aef4564e7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29754eda-625a-4751-b83b-6aef4564e7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9859b83c-7f85-4fc6-9f77-5894afa5834f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume 9135cebe-8f57-4553-878b-0e1e05c58ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9135cebe-8f57-4553-878b-0e1e05c58ca7', 'volume_size': 1} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:50 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c 1073741824" returned: 0 in 0.896s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:50 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c Apr 24 19:25:50 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Flow 'volume_create_manager' (2cb1264b-1727-43cb-889b-15e63ef760a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c87636a-040e-4713-b6da-ee212f45dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c87636a-040e-4713-b6da-ee212f45dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-697766683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13a98eb-eaee-429a-ab9e-dfeef66868f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca20f9687764671ba461ccdd92d19eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='1272061ba4f54c22a5149b580860d197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42970e02-d012-4698-b082-219ebd6e4441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42970e02-d012-4698-b082-219ebd6e4441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3de82bf-6387-4c22-9e1b-c9a969400f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3de82bf-6387-4c22-9e1b-c9a969400f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a13a98eb-eaee-429a-ab9e-dfeef66868f9', 'volume_name': 'volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0108344c-3120-4571-8e7b-1caa489ce8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0108344c-3120-4571-8e7b-1caa489ce8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51835e6d-7f38-4a1d-9477-17aee105e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Volume a13a98eb-eaee-429a-ab9e-dfeef66868f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9', 'volume_size': 1} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:51 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c" returned: 0 in 0.477s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.451s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-153512031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07593364-e88a-4065-b8d0-be678edb8bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfda9bbb63a24bbb9d8485152051249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:42Z,use_quota=True,user_id='004e75d3c7e0499a8fe8a41e97616df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Creating volume 07593364-e88a-4065-b8d0-be678edb8bcb {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:51 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:51 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb 1073741824 Apr 24 19:25:51 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2c89ff-5da8-4c0b-83b8-213f67fad844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82652f86-2fee-430d-b432-f690a3391e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c (7e14b63d-70ad-4e0e-be9a-765ae8e1988c): created successfully Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82652f86-2fee-430d-b432-f690a3391e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (6893b786-aaab-4b51-9cc4-1abacaed1f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:51 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-30515914-ccf5-4056-a45c-834398f5a044 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created volume successfully. Apr 24 19:25:52 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb 1073741824" returned: 0 in 0.673s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:52 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb Apr 24 19:25:52 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:52 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb" returned: 0 in 0.517s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.681s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-d6906ff1-7b58-451f-9d69-86143573c75e-e51500a6-2b35-4f55-b945-b04cadeb7b51" by "_create_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a034fc-3478-45e5-aa74-329315a05c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07593364-e88a-4065-b8d0-be678edb8bcb', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4265dab4-2234-4d11-9227-0acefde555d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:52 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Volume volume-07593364-e88a-4065-b8d0-be678edb8bcb (07593364-e88a-4065-b8d0-be678edb8bcb): created successfully Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4265dab4-2234-4d11-9227-0acefde555d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Flow 'volume_create_manager' (8a4d8f31-6083-4251-853b-cfd516d6f534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-d6906ff1-7b58-451f-9d69-86143573c75e-e51500a6-2b35-4f55-b945-b04cadeb7b51" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Creating volume e51500a6-2b35-4f55-b945-b04cadeb7b51 from snapshot d6906ff1-7b58-451f-9d69-86143573c75e {{(pid=81522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-e51500a6-2b35-4f55-b945-b04cadeb7b51" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-e51500a6-2b35-4f55-b945-b04cadeb7b51" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] snapshot: d6906ff1-7b58-451f-9d69-86143573c75e, volume: e51500a6-2b35-4f55-b945-b04cadeb7b51, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:52 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-28d38657-3fdb-4b87-a22f-5a65c7bad3bb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created volume successfully. Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[025aea7f-6167-48a4-a1c7-190fe7fef56a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:52 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e Apr 24 19:25:52 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-07593364-e88a-4065-b8d0-be678edb8bcb-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-07593364-e88a-4065-b8d0-be678edb8bcb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:53 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e" returned: 0 in 0.623s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90853384-7991-492b-80a6-535ad0a46960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31cfffa-7399-4377-8c3b-b6e2a32a86b6]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:53 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 Apr 24 19:25:53 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-quobyte-07593364-e88a-4065-b8d0-be678edb8bcb" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-07593364-e88a-4065-b8d0-be678edb8bcb" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17b381-6abc-4c3c-908c-227052a28b3a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:53 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb Apr 24 19:25:53 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:54 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960" returned: 0 in 0.600s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:54 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:25:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:54 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 Apr 24 19:25:54 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:54 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb" returned: 0 in 0.598s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:54 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb Apr 24 19:25:54 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:55 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-07593364-e88a-4065-b8d0-be678edb8bcb" returned: 0 in 0.642s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-07593364-e88a-4065-b8d0-be678edb8bcb" released by "delete_volume" :: held 1.296s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:56 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created reservations ['e920410e-8fcb-4e36-a6a6-e8869473e332', 'a5abb6c9-3bef-4dbf-8da4-a4d50f7683d7', '7c76729d-4978-4024-a145-fe94ab3bc352', '61fe7f08-2530-417d-85ab-a610fb4ecc3d'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:57 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:57 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:57 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:25:57 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-7e14b63d-70ad-4e0e-be9a-765ae8e1988c-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-7e14b63d-70ad-4e0e-be9a-765ae8e1988c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-quobyte-7e14b63d-70ad-4e0e-be9a-765ae8e1988c" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:58 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-7e14b63d-70ad-4e0e-be9a-765ae8e1988c" acquired by "delete_volume" :: waited 0.048s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:58 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4cb386-e705-4b4c-9eec-5238f0d535ff]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:58 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:58 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c Apr 24 19:25:58 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:59 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.602s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:59 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:59 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Deleted volume successfully. Apr 24 19:25:59 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-475a19ca-7d9c-49c3-ab04-89c509b1dbe8 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-07593364-e88a-4065-b8d0-be678edb8bcb-delete_volume" released by "delete_volume" :: held 6.114s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:59 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51" returned: 0 in 5.551s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:59 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[672dc898-5459-4841-affc-f75d4a66be74]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:59 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c" returned: 0 in 1.144s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:59 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:59 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c Apr 24 19:25:59 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:59 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 Apr 24 19:25:59 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:00 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-7e14b63d-70ad-4e0e-be9a-765ae8e1988c" returned: 0 in 0.482s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-7e14b63d-70ad-4e0e-be9a-765ae8e1988c" released by "delete_volume" :: held 1.704s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created reservations ['fbdf95ef-2d44-434a-a3ae-e85af14903e4', '681707e3-9233-408b-bf77-2a44216eff09', 'b7ccb0b9-ccf3-4906-8c8b-49d5ad225317', '7c627f21-bef2-4ce1-8f12-b1b83efd93b5'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:00 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960" returned: 0 in 0.720s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:26:00 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Converted 1024.00 MB image at 184.44 MB/s Apr 24 19:26:00 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 is being set with open permissions: ugo+rw Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:00 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:00 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:00 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 Apr 24 19:26:00 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-e45addca-7b3b-45f5-9e5f-651f3e9c49c3-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-e45addca-7b3b-45f5-9e5f-651f3e9c49c3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-quobyte-e45addca-7b3b-45f5-9e5f-651f3e9c49c3" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-e45addca-7b3b-45f5-9e5f-651f3e9c49c3" acquired by "delete_volume" :: waited 0.031s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1abee6c-7418-44d5-88e6-50e5dea1e9db]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:00 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 Apr 24 19:26:00 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:00 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51" returned: 0 in 0.521s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-e51500a6-2b35-4f55-b945-b04cadeb7b51" released by "_copy_volume_from_snapshot" :: held 8.132s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-d6906ff1-7b58-451f-9d69-86143573c75e-e51500a6-2b35-4f55-b945-b04cadeb7b51" released by "_create_volume_from_snapshot" :: held 8.171s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.227s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.107s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1498412520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9135cebe-8f57-4553-878b-0e1e05c58ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Creating volume 9135cebe-8f57-4553-878b-0e1e05c58ca7 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:00 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:00 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.584s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:00 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 1073741824 Apr 24 19:26:00 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:00 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Deleted volume successfully. Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd3fce2-492b-475f-b832-1de0962e4f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51500a6-2b35-4f55-b945-b04cadeb7b51', 'volume_size': 1, 'snapshot_id': 'd6906ff1-7b58-451f-9d69-86143573c75e'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06640a3-894d-4882-a6e6-1c5f03898682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-664f6a7c-9d79-4839-8607-a2dfe72c6903 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-7e14b63d-70ad-4e0e-be9a-765ae8e1988c-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:00 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Volume volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 (e51500a6-2b35-4f55-b945-b04cadeb7b51): created successfully Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06640a3-894d-4882-a6e6-1c5f03898682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Flow 'volume_create_manager' (be3d5437-d216-4d83-89cb-2d240e508197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:00 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f488a676-fa0c-4e61-b459-f2424d0dd30d tempest-VolumeDependencyTests-1595374147 None] Created volume successfully. Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-d6906ff1-7b58-451f-9d69-86143573c75e-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-d6906ff1-7b58-451f-9d69-86143573c75e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-90853384-7991-492b-80a6-535ad0a46960" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-90853384-7991-492b-80a6-535ad0a46960" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-d6906ff1-7b58-451f-9d69-86143573c75e" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-d6906ff1-7b58-451f-9d69-86143573c75e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Deleting offline snapshot d6906ff1-7b58-451f-9d69-86143573c75e of volume 90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] snapshot_file for this snap is: volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[68638a52-7f39-48de-ad4b-50d9a3e6de24]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:01 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e Apr 24 19:26:01 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:01 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3" returned: 0 in 0.631s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:01 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3 Apr 24 19:26:01 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:01 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 1073741824" returned: 0 in 0.803s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:01 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 Apr 24 19:26:01 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:01 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e" returned: 0 in 0.662s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90853384-7991-492b-80a6-535ad0a46960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:01 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e45addca-7b3b-45f5-9e5f-651f3e9c49c3" returned: 0 in 0.531s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc333a1-4c55-4497-8016-f39ac487642c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-e45addca-7b3b-45f5-9e5f-651f3e9c49c3" released by "delete_volume" :: held 1.225s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:01 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created reservations ['a66aef0f-ca78-4534-a325-ae12b3e2315b', '622578d4-b284-43e9-9720-639dcedaad17', 'fd3b2b98-3df0-4f47-8d32-c619fa0930bc', '04cd303e-8373-4f48-868d-856686130adc'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:01 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 Apr 24 19:26:01 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:02 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:02 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:02 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7" returned: 0 in 0.563s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.187s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-697766683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13a98eb-eaee-429a-ab9e-dfeef66868f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca20f9687764671ba461ccdd92d19eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='1272061ba4f54c22a5149b580860d197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Creating volume a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:02 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9859b83c-7f85-4fc6-9f77-5894afa5834f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9135cebe-8f57-4553-878b-0e1e05c58ca7', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744be309-cc75-40ed-994b-59800dae7198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:02 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 1073741824 Apr 24 19:26:02 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:02 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 (9135cebe-8f57-4553-878b-0e1e05c58ca7): created successfully Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744be309-cc75-40ed-994b-59800dae7198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (c059b5b2-57a1-44ef-91a8-5ede32503599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:02 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-25956ca4-3729-4500-ae26-615f1e165846 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created volume successfully. Apr 24 19:26:02 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960" returned: 0 in 0.593s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:02 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e Apr 24 19:26:02 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:02 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.560s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:02 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Deleted volume successfully. Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-82400a7f-8ff9-4396-ad25-240ba0d28770 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-e45addca-7b3b-45f5-9e5f-651f3e9c49c3-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-8cfbcd5d-352d-4687-917a-0e0f17c74afd-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:02 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-8cfbcd5d-352d-4687-917a-0e0f17c74afd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-quobyte-8cfbcd5d-352d-4687-917a-0e0f17c74afd" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-8cfbcd5d-352d-4687-917a-0e0f17c74afd" acquired by "delete_volume" :: waited 0.044s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f63926-f6ae-4dd5-b1d7-4882aec13d66]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (d89d655a-6033-4e8c-b0d7-19c2a3e68d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed84d05d-fa93-4c85-b217-3d950cedd97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd Apr 24 19:26:03 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed84d05d-fa93-4c85-b217-3d950cedd97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-212003329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9bf752-30ac-4ba8-b7d6-ed533e2765ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:03Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058564fc-0c79-40e3-bf7f-ab71fcc4882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058564fc-0c79-40e3-bf7f-ab71fcc4882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9803d5e9-de40-444e-8675-6b9c1292934d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9803d5e9-de40-444e-8675-6b9c1292934d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9bf752-30ac-4ba8-b7d6-ed533e2765ab', 'volume_name': 'volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe8384f-591c-4d13-9f49-d310199552f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe8384f-591c-4d13-9f49-d310199552f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082c79e6-a9bd-4e9d-8c23-b4c6d0533bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume 4b9bf752-30ac-4ba8-b7d6-ed533e2765ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab', 'volume_size': 1} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e" returned: 0 in 0.786s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:03 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 1073741824" returned: 0 in 1.030s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:03 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e Apr 24 19:26:03 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:03 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 Apr 24 19:26:03 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (a39c5ac6-23a0-4cb3-9211-99c97aa5981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c23de9-221b-4d19-be34-b4dc1896be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c23de9-221b-4d19-be34-b4dc1896be95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629374373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8698474-6c8d-4482-b614-248152b94b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:04Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c0d9a1-ec58-43e3-9648-173c08407733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c0d9a1-ec58-43e3-9648-173c08407733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364f53d0-8a5a-4602-828b-19fb6d225c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364f53d0-8a5a-4602-828b-19fb6d225c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8698474-6c8d-4482-b614-248152b94b22', 'volume_name': 'volume-c8698474-6c8d-4482-b614-248152b94b22', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b46644a-58bf-4be2-8f0d-50e6d6794f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b46644a-58bf-4be2-8f0d-50e6d6794f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fe69f6-b210-4632-bbc0-c4f480162046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume c8698474-6c8d-4482-b614-248152b94b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8698474-6c8d-4482-b614-248152b94b22', 'volume_size': 1} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (2f78f372-541e-4a14-b1b6-1a5c9f1fcb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b3b75a-96cb-4a64-83be-f3b1d2d53188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b3b75a-96cb-4a64-83be-f3b1d2d53188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956855737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c7f1af-a646-4f6e-acea-4aa92254f778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:04Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5cce19-838e-4c83-a794-f1b1f405e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5cce19-838e-4c83-a794-f1b1f405e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639c6fb5-db23-4c60-b088-7fe8927385a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639c6fb5-db23-4c60-b088-7fe8927385a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c7f1af-a646-4f6e-acea-4aa92254f778', 'volume_name': 'volume-c3c7f1af-a646-4f6e-acea-4aa92254f778', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7ceabf-72fa-4aaa-a247-2201a3c9c34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7ceabf-72fa-4aaa-a247-2201a3c9c34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d30f73-2e47-4047-bce5-5d6ff6156772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume c3c7f1af-a646-4f6e-acea-4aa92254f778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c7f1af-a646-4f6e-acea-4aa92254f778', 'volume_size': 1} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:04 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:04 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd" returned: 0 in 0.919s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:04 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960.d6906ff1-7b58-451f-9d69-86143573c75e" returned: 0 in 0.756s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9" returned: 0 in 0.699s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.783s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-212003329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9bf752-30ac-4ba8-b7d6-ed533e2765ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:03Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Creating volume 4b9bf752-30ac-4ba8-b7d6-ed533e2765ab {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:04 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd Apr 24 19:26:04 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:04 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51835e6d-7f38-4a1d-9477-17aee105e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418149f5-8305-4f1e-9c3e-f8c1369f9629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab 1073741824 Apr 24 19:26:04 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:04 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Volume volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 (a13a98eb-eaee-429a-ab9e-dfeef66868f9): created successfully Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418149f5-8305-4f1e-9c3e-f8c1369f9629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Flow 'volume_create_manager' (2cb1264b-1727-43cb-889b-15e63ef760a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-d6906ff1-7b58-451f-9d69-86143573c75e" released by "_delete_snapshot" :: held 3.057s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:04 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-8d7d0bd6-3de1-48a5-9ea8-9059cc9d5fdf tempest-SnapshotDependencyTests-214896251 None] Created volume successfully. Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-90853384-7991-492b-80a6-535ad0a46960" released by "delete_snapshot" :: held 3.097s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Created reservations ['a22ac612-5ef0-4877-8a16-4a4a58761f82', '7dc9c6e8-2345-40db-9634-e70936c30509', '588864cd-4485-4610-a9dc-266c4a8bd9e6', 'bce286a8-f5c3-40a8-a9c5-55db1f8f0907'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (32eb28c5-3792-421a-8d62-0ff834daf809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d72d9cb-34c3-4213-8e5e-d875405a6566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d72d9cb-34c3-4213-8e5e-d875405a6566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474994848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2579addc-6737-4755-9596-2d9c3269f1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:04Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e2aef6-07a1-4796-ba06-d83f8f2c2c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e2aef6-07a1-4796-ba06-d83f8f2c2c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca8c2b2-ce53-41f5-af8d-47755f295237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca8c2b2-ce53-41f5-af8d-47755f295237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2579addc-6737-4755-9596-2d9c3269f1a9', 'volume_name': 'volume-2579addc-6737-4755-9596-2d9c3269f1a9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b678906-9e75-449e-a7ea-424859bafb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b678906-9e75-449e-a7ea-424859bafb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e447d6be-47a3-4c81-993b-99ede185a036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume 2579addc-6737-4755-9596-2d9c3269f1a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2579addc-6737-4755-9596-2d9c3269f1a9', 'volume_size': 1} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:04 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Delete snapshot completed successfully. Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-f03e5588-7340-4582-8eb2-21650d6d2a41 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-d6906ff1-7b58-451f-9d69-86143573c75e-delete_snapshot" released by "delete_snapshot" :: held 3.409s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (10c70dd3-2a6a-46f3-a488-37234fb56c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a3ed7a-efd6-40ce-8cef-c778e57bc7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a3ed7a-efd6-40ce-8cef-c778e57bc7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972933649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a10ae8-3532-4614-8f70-9d10a03a64c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:05Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b533914-aedf-489f-bb11-38bda8e3ca83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b533914-aedf-489f-bb11-38bda8e3ca83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c6e9aa-119e-48af-99ef-c22d04fd9d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c6e9aa-119e-48af-99ef-c22d04fd9d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a10ae8-3532-4614-8f70-9d10a03a64c1', 'volume_name': 'volume-51a10ae8-3532-4614-8f70-9d10a03a64c1', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b408b97a-1a02-4843-9ade-a05514fce28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b408b97a-1a02-4843-9ade-a05514fce28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bab81b-7c12-433d-9b57-89f0bbf0f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:04 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume 51a10ae8-3532-4614-8f70-9d10a03a64c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a10ae8-3532-4614-8f70-9d10a03a64c1', 'volume_size': 1} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:04 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-8cfbcd5d-352d-4687-917a-0e0f17c74afd" returned: 0 in 0.770s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-8cfbcd5d-352d-4687-917a-0e0f17c74afd" released by "delete_volume" :: held 1.733s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created reservations ['0e934540-46ae-4d18-a1bd-1c4478e1c88b', '143c4bff-354b-4cc5-ba62-7237e6cd7edf', 'f17479f6-cb4c-4efc-bfc3-e8e819d2ada4', '7b6cbacc-2ef0-48bd-b9b1-e952b7ac7b63'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:04 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab 1073741824" returned: 0 in 0.854s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:04 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:04 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:04 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:04 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab Apr 24 19:26:04 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-f81360f4-e7d4-4db5-8c9f-a10019b7a555-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-f81360f4-e7d4-4db5-8c9f-a10019b7a555-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-quobyte-f81360f4-e7d4-4db5-8c9f-a10019b7a555" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-f81360f4-e7d4-4db5-8c9f-a10019b7a555" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[333771fd-5820-44e1-ba23-2e59e617af4f]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-90853384-7991-492b-80a6-535ad0a46960-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-90853384-7991-492b-80a6-535ad0a46960-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:05 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 Apr 24 19:26:05 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:05 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-90853384-7991-492b-80a6-535ad0a46960" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab" returned: 0 in 0.568s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.813s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629374373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8698474-6c8d-4482-b614-248152b94b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:04Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Creating volume c8698474-6c8d-4482-b614-248152b94b22 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:05 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082c79e6-a9bd-4e9d-8c23-b4c6d0533bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:05 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2bebdc-4351-4972-abae-744b640c5558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-90853384-7991-492b-80a6-535ad0a46960" acquired by "delete_volume" :: waited 0.078s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:05 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22 1073741824 Apr 24 19:26:05 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.733s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b19980-0125-4cac-88cc-3193cd17df14]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:05 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Deleted volume successfully. Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:05 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab (4b9bf752-30ac-4ba8-b7d6-ed533e2765ab): created successfully Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2bebdc-4351-4972-abae-744b640c5558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (d89d655a-6033-4e8c-b0d7-19c2a3e68d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:05 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-4386b90d-2262-4884-84cc-64e9db9628c2 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created volume successfully. Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ae59f645-0e2c-483a-abf1-2c9f49301af6 tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-8cfbcd5d-352d-4687-917a-0e0f17c74afd-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:05 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:05 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 Apr 24 19:26:05 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:06 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555" returned: 0 in 0.767s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:06 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555 Apr 24 19:26:06 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:06 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960" returned: 0 in 0.658s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:06 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960 Apr 24 19:26:06 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:06 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22 1073741824" returned: 0 in 0.846s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:06 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22 Apr 24 19:26:06 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:06 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-f81360f4-e7d4-4db5-8c9f-a10019b7a555" returned: 0 in 0.541s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-f81360f4-e7d4-4db5-8c9f-a10019b7a555" released by "delete_volume" :: held 1.378s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created reservations ['445fd424-bdf9-4a62-a0e4-467572fcc811', '3049a1df-1aa7-4bbe-bd29-7311b557fc90', 'a167020e-76ee-454c-8c3f-587453ff537a', '9a32a97e-d0b8-484b-98c1-ec0b7f17c96e'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:06 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:06 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:06 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-90853384-7991-492b-80a6-535ad0a46960" returned: 0 in 0.569s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-90853384-7991-492b-80a6-535ad0a46960" released by "delete_volume" :: held 1.324s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:06 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Created reservations ['fb242bb4-aeac-402b-9552-fd27393727bc', 'a497d156-8b9f-41e1-abc9-74ab87a7876c', 'f6009329-0b34-400c-9e30-8eca650437ad', '135c042d-03b0-47df-ac68-4680b8071072'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:07 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22" returned: 0 in 0.613s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.060s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956855737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c7f1af-a646-4f6e-acea-4aa92254f778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:04Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Creating volume c3c7f1af-a646-4f6e-acea-4aa92254f778 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:07 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fe69f6-b210-4632-bbc0-c4f480162046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8698474-6c8d-4482-b614-248152b94b22', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44b3cb4-d264-4e92-b253-d8b49e5d4444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:07 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 1073741824 Apr 24 19:26:07 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:07 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume volume-c8698474-6c8d-4482-b614-248152b94b22 (c8698474-6c8d-4482-b614-248152b94b22): created successfully Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44b3cb4-d264-4e92-b253-d8b49e5d4444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:07 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:07 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (a39c5ac6-23a0-4cb3-9211-99c97aa5981e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:07 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7073c0c2-207c-4726-a880-b64bcecc5cfa tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created volume successfully. Apr 24 19:26:07 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.572s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:07 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Deleted volume successfully. Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a5e9b5f7-0d98-42d7-91ea-e0931185ba0e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-f81360f4-e7d4-4db5-8c9f-a10019b7a555-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-201b4296-46ae-4b94-821a-e3d9bf817793-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-201b4296-46ae-4b94-821a-e3d9bf817793-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-quobyte-1a62538a-5713-415e-8c6a-a46e22c4eb5e" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-1a62538a-5713-415e-8c6a-a46e22c4eb5e" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-quobyte-201b4296-46ae-4b94-821a-e3d9bf817793" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-201b4296-46ae-4b94-821a-e3d9bf817793" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Deleting offline snapshot 201b4296-46ae-4b94-821a-e3d9bf817793 of volume 1a62538a-5713-415e-8c6a-a46e22c4eb5e {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] snapshot_file for this snap is: volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd48bd9-9d5c-454f-aea9-5e1b1d453088]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:07 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:07 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 Apr 24 19:26:07 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:08 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 1073741824" returned: 0 in 1.012s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:08 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.002s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:08 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Deleted volume successfully. Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e24387f1-8730-4ea5-bab8-fa50c6290b5a tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-90853384-7991-492b-80a6-535ad0a46960-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:08 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 Apr 24 19:26:08 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Flow 'volume_create_manager' (60eb5722-6303-4cc2-84f3-323e94ea83a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0a6b5a-ba1f-409b-a452-540e58ea0676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0a6b5a-ba1f-409b-a452-540e58ea0676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-725723514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646dfd79-db5a-4882-8549-c7ca501932ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a5eb3dc8184a1f90842e151d1efaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:08Z,use_quota=True,user_id='4d54c538a85441e38839c5ae8b24f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0a466d-c4d0-4c5e-aa69-60404a9e5b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0a466d-c4d0-4c5e-aa69-60404a9e5b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc208e1-0b59-4840-bf71-21c008152e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc208e1-0b59-4840-bf71-21c008152e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646dfd79-db5a-4882-8549-c7ca501932ea', 'volume_name': 'volume-646dfd79-db5a-4882-8549-c7ca501932ea', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fa559f-af91-4a06-8dd2-274001a4652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fa559f-af91-4a06-8dd2-274001a4652f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccabed7-dafb-4ee1-a1c5-3bc9f8b5bbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:08 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Volume 646dfd79-db5a-4882-8549-c7ca501932ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646dfd79-db5a-4882-8549-c7ca501932ea', 'volume_size': 1} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:08 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793" returned: 0 in 0.727s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[232ce637-60b5-4abc-a8d3-4b3e0ccb951e]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:08 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e Apr 24 19:26:08 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:08 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778" returned: 0 in 0.531s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.220s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474994848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2579addc-6737-4755-9596-2d9c3269f1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:04Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Creating volume 2579addc-6737-4755-9596-2d9c3269f1a9 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:08 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d30f73-2e47-4047-bce5-5d6ff6156772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c7f1af-a646-4f6e-acea-4aa92254f778', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ac0040-cf4b-445b-afc0-38043ed751d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:08 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9 1073741824 Apr 24 19:26:08 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:08 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 (c3c7f1af-a646-4f6e-acea-4aa92254f778): created successfully Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ac0040-cf4b-445b-afc0-38043ed751d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:08 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (2f78f372-541e-4a14-b1b6-1a5c9f1fcb72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:08 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-393d07f2-9067-49a8-b7f1-546ef1914372 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created volume successfully. Apr 24 19:26:09 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e" returned: 0 in 0.661s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:09 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 Apr 24 19:26:09 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:09 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9 1073741824" returned: 0 in 0.780s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:09 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9 Apr 24 19:26:09 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:09 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793" returned: 0 in 0.659s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:09 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:09 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793 Apr 24 19:26:09 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:10 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9" returned: 0 in 0.567s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.426s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972933649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a10ae8-3532-4614-8f70-9d10a03a64c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872d6c8e19f742ae879e2454d66a934f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:05Z,use_quota=True,user_id='8e809fa6667e4e6d8cd88030d544738a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Creating volume 51a10ae8-3532-4614-8f70-9d10a03a64c1 {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:10 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e447d6be-47a3-4c81-993b-99ede185a036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2579addc-6737-4755-9596-2d9c3269f1a9', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1ecc32-bd34-4a56-a509-d4965bd7a600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:10 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 1073741824 Apr 24 19:26:10 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:10 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume volume-2579addc-6737-4755-9596-2d9c3269f1a9 (2579addc-6737-4755-9596-2d9c3269f1a9): created successfully Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1ecc32-bd34-4a56-a509-d4965bd7a600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (32eb28c5-3792-421a-8d62-0ff834daf809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-139da0cc-af32-4452-9b27-aee9a4e1b4f4 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created volume successfully. Apr 24 19:26:10 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e.201b4296-46ae-4b94-821a-e3d9bf817793" returned: 0 in 0.490s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-201b4296-46ae-4b94-821a-e3d9bf817793" released by "_delete_snapshot" :: held 2.723s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-1a62538a-5713-415e-8c6a-a46e22c4eb5e" released by "delete_snapshot" :: held 2.809s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created reservations ['ef78abb8-da6e-419b-b2d5-955904293fb3', 'ecbfcc5c-9047-4d00-aac9-c9e318f2f671', 'eec238d6-53f0-4d26-97fb-4b5f0f5bd377', '27617d32-69af-4cdf-b5ab-a325484b55ad'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:10 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Delete snapshot completed successfully. Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e78da730-1432-4ce2-bf55-4b5875c87f2e tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-201b4296-46ae-4b94-821a-e3d9bf817793-delete_snapshot" released by "delete_snapshot" :: held 2.979s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-1a62538a-5713-415e-8c6a-a46e22c4eb5e-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-1a62538a-5713-415e-8c6a-a46e22c4eb5e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "cinder-quobyte-1a62538a-5713-415e-8c6a-a46e22c4eb5e" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-1a62538a-5713-415e-8c6a-a46e22c4eb5e" acquired by "delete_volume" :: waited 0.032s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:10 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 1073741824" returned: 0 in 0.793s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1574e83-eb4b-4148-b326-affe91b2fc4a]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:10 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 Apr 24 19:26:10 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:11 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e Apr 24 19:26:11 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:11 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1" returned: 0 in 0.529s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.754s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Creating offline snapshot 8227261e-6de9-4f14-ba40-4da0270d3df0 of volume a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bab81b-7c12-433d-9b57-89f0bbf0f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a10ae8-3532-4614-8f70-9d10a03a64c1', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51be678-3c55-4bc8-9548-69b223e5d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1967d8-a2f6-4000-86ce-1c5509f53892]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:11 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e" returned: 0 in 0.633s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:11 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Volume volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 (51a10ae8-3532-4614-8f70-9d10a03a64c1): created successfully Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51be678-3c55-4bc8-9548-69b223e5d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:11 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Flow 'volume_create_manager' (10c70dd3-2a6a-46f3-a488-37234fb56c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:11 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e Apr 24 19:26:11 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:11 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-760bd197-344a-457f-903f-aa152b1cf71f tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created volume successfully. Apr 24 19:26:11 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 Apr 24 19:26:11 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:12 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-1a62538a-5713-415e-8c6a-a46e22c4eb5e" returned: 0 in 0.503s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-quobyte-1a62538a-5713-415e-8c6a-a46e22c4eb5e" released by "delete_volume" :: held 1.198s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Created reservations ['336b5b7a-c7cb-423d-910d-1097a8a882d3', 'a3348bd1-864d-4d78-bfd8-fcc8cdc3b8d0', 'acb6d558-8b60-4ac8-97a1-e973fc4d97cc', 'a88fc71d-463c-4aef-8f6c-b289ccbdbd4b'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:12 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9" returned: 0 in 0.650s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:12 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 1G Apr 24 19:26:12 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:12 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:12 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-51a10ae8-3532-4614-8f70-9d10a03a64c1-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-51a10ae8-3532-4614-8f70-9d10a03a64c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-quobyte-51a10ae8-3532-4614-8f70-9d10a03a64c1" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-51a10ae8-3532-4614-8f70-9d10a03a64c1" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[89be6ab0-cecd-4ad8-9c18-66210539e7bb]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:12 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:12 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 Apr 24 19:26:12 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.553s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:12 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Deleted volume successfully. Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-5487b1e9-ffa0-4fab-9904-3f66483142fb tempest-CreateVolumesFromSnapshotTest-2119254090 None] Lock "cinder-1a62538a-5713-415e-8c6a-a46e22c4eb5e-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:12 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 1G" returned: 0 in 0.749s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:12 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 Apr 24 19:26:12 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:13 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1" returned: 0 in 0.697s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:13 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1 Apr 24 19:26:13 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:13 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0" returned: 0 in 0.565s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:13 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 is being set with open permissions: ugo+rw Apr 24 19:26:13 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:13 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 Apr 24 19:26:13 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:14 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-51a10ae8-3532-4614-8f70-9d10a03a64c1" returned: 0 in 0.633s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-51a10ae8-3532-4614-8f70-9d10a03a64c1" released by "delete_volume" :: held 1.386s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created reservations ['3cad2ea7-157b-45a1-8adc-c6965502717e', '6e983b59-e847-4f1a-968d-7d131b8711d7', '17a70331-235f-42ef-995c-e008cf6e8b16', '6f635d34-42cb-4ee3-8174-c4d5137bdcea'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:14 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0" returned: 0 in 0.633s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:14 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:14 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:14 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.info Apr 24 19:26:14 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:14 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.612s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:14 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Deleted volume successfully. Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-2579addc-6737-4755-9596-2d9c3269f1a9-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-88bf2ef5-43a4-49a7-9089-800c1e067a92 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-51a10ae8-3532-4614-8f70-9d10a03a64c1-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-2579addc-6737-4755-9596-2d9c3269f1a9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-quobyte-2579addc-6737-4755-9596-2d9c3269f1a9" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-2579addc-6737-4755-9596-2d9c3269f1a9" acquired by "delete_volume" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:14 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.info" returned: 0 in 0.768s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:14 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.info is being set with open permissions: ugo+rw Apr 24 19:26:14 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2779adc6-3b26-4b14-adb0-cc8838426e5c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:15 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.info Apr 24 19:26:15 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:15 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9 Apr 24 19:26:15 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:15 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.info" returned: 0 in 0.577s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.094s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.202s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-725723514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646dfd79-db5a-4882-8549-c7ca501932ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a5eb3dc8184a1f90842e151d1efaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:08Z,use_quota=True,user_id='4d54c538a85441e38839c5ae8b24f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Creating volume 646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:15 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:15 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea 1073741824 Apr 24 19:26:15 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:15 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-6935a108-2f98-4879-b5e5-14ccd6a910cd tempest-SnapshotDependencyTests-214896251 None] Create snapshot completed successfully Apr 24 19:26:15 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9" returned: 0 in 0.760s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:15 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:15 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9 Apr 24 19:26:15 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:16 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-2579addc-6737-4755-9596-2d9c3269f1a9" returned: 0 in 0.625s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:16 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea 1073741824" returned: 0 in 0.797s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-2579addc-6737-4755-9596-2d9c3269f1a9" released by "delete_volume" :: held 1.469s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:16 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea Apr 24 19:26:16 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created reservations ['f8439c06-eaf4-4457-9d39-00ebe206b564', 'e2e796f2-c3fd-4a08-b69b-b4b218ad819e', '99a20c46-d617-4554-887d-35012bb2783f', 'cd96ce95-7d24-42cb-b54c-0d4ff6c45ba1'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Flow 'volume_create_manager' (f7e4fc93-1daa-479d-bf4d-86ce26e4bc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7f8bed-8906-41e3-9f14-036a57ea644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7f8bed-8906-41e3-9f14-036a57ea644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c30385-210a-4daa-941a-f329abbef5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9734d9e78d4e2a91adc31e9ab8f392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:16Z,use_quota=True,user_id='d7c90d9caa1c4b21a68ed03707e8d8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd1e489-89c9-4b2f-a1a0-920e23b96426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd1e489-89c9-4b2f-a1a0-920e23b96426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0dc989b-6c76-4804-b22a-1737b5113d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0dc989b-6c76-4804-b22a-1737b5113d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c30385-210a-4daa-941a-f329abbef5cd', 'volume_name': 'volume-89c30385-210a-4daa-941a-f329abbef5cd', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d0f2eb-b039-4c74-bfef-89adacccd4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d0f2eb-b039-4c74-bfef-89adacccd4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf83fda3-c6bc-418e-ac71-996673dbfcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:16 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Volume 89c30385-210a-4daa-941a-f329abbef5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c30385-210a-4daa-941a-f329abbef5cd', 'volume_size': 1} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:16 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:16 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Flow 'volume_create_manager' (70d89260-ff5c-4a6f-b03e-14196d1eefda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae77995-ae2b-4509-898f-e0c879320760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae77995-ae2b-4509-898f-e0c879320760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7ae135-7ac4-441c-a593-7727f3ea2323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca20f9687764671ba461ccdd92d19eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8227261e-6de9-4f14-ba40-4da0270d3df0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:17Z,use_quota=True,user_id='1272061ba4f54c22a5149b580860d197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:16 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a8acc2-8ef4-419b-a3c2-1c406851d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a8acc2-8ef4-419b-a3c2-1c406851d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fbd9e0-1479-45a9-8a1b-7b807e1a1252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:17 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fbd9e0-1479-45a9-8a1b-7b807e1a1252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c7ae135-7ac4-441c-a593-7727f3ea2323', 'volume_name': 'volume-3c7ae135-7ac4-441c-a593-7727f3ea2323', 'volume_size': 1, 'snapshot_id': '8227261e-6de9-4f14-ba40-4da0270d3df0'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8c225c-819d-4261-9104-de4cf4439fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8c225c-819d-4261-9104-de4cf4439fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eacb62-2500-4f8b-bf67-d8741e71e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:17 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Volume 3c7ae135-7ac4-441c-a593-7727f3ea2323: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c7ae135-7ac4-441c-a593-7727f3ea2323', 'volume_size': 1, 'snapshot_id': '8227261e-6de9-4f14-ba40-4da0270d3df0'} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea" returned: 0 in 0.536s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c30385-210a-4daa-941a-f329abbef5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9734d9e78d4e2a91adc31e9ab8f392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:16Z,use_quota=True,user_id='d7c90d9caa1c4b21a68ed03707e8d8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Creating volume 89c30385-210a-4daa-941a-f329abbef5cd {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:17 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccabed7-dafb-4ee1-a1c5-3bc9f8b5bbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646dfd79-db5a-4882-8549-c7ca501932ea', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d84b3a-8e8f-4c81-bcb6-49859e284409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:17 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd 1073741824 Apr 24 19:26:17 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:17 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Volume volume-646dfd79-db5a-4882-8549-c7ca501932ea (646dfd79-db5a-4882-8549-c7ca501932ea): created successfully Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d84b3a-8e8f-4c81-bcb6-49859e284409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Flow 'volume_create_manager' (60eb5722-6303-4cc2-84f3-323e94ea83a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:17 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-7bbcd7b0-f5d4-4c41-ac17-1cf80cf67446 tempest-VolumeDependencyTests-1595374147 None] Created volume successfully. Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-c3c7f1af-a646-4f6e-acea-4aa92254f778-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-c3c7f1af-a646-4f6e-acea-4aa92254f778-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-quobyte-c3c7f1af-a646-4f6e-acea-4aa92254f778" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-c3c7f1af-a646-4f6e-acea-4aa92254f778" acquired by "delete_volume" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ba4fd-22a9-4814-ae10-605550752c32]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:17 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 Apr 24 19:26:17 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:17 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.683s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:17 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Deleted volume successfully. Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ee00c8bd-79f4-4ddc-b190-fdefa07a7c94 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-2579addc-6737-4755-9596-2d9c3269f1a9-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:17 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778" returned: 0 in 0.584s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:17 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd 1073741824" returned: 0 in 0.859s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:17 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778 Apr 24 19:26:17 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:17 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:17 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd Apr 24 19:26:17 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Flow 'volume_create_manager' (ee033dfa-ea11-4e99-9b9a-e890adecf3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd634375-2ac7-4900-ad5b-e30d5804e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd634375-2ac7-4900-ad5b-e30d5804e55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-492081154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a49f8cf-9789-4520-a27a-72145251db0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a5eb3dc8184a1f90842e151d1efaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=646dfd79-db5a-4882-8549-c7ca501932ea,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:18Z,use_quota=True,user_id='4d54c538a85441e38839c5ae8b24f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f8f973-2ae6-46e8-a15e-011bf3c62fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f8f973-2ae6-46e8-a15e-011bf3c62fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2433afc1-f138-435f-a145-a34b8181b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:18 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2433afc1-f138-435f-a145-a34b8181b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4a49f8cf-9789-4520-a27a-72145251db0e', 'volume_name': 'volume-4a49f8cf-9789-4520-a27a-72145251db0e', 'volume_size': 1, 'source_volid': '646dfd79-db5a-4882-8549-c7ca501932ea', 'source_volstatus': 'available'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d454b0b7-1272-4961-b427-38a08b0a5779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d454b0b7-1272-4961-b427-38a08b0a5779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ef0ca3-63b2-4cf3-8873-2a317f8ff409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:18 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Volume 4a49f8cf-9789-4520-a27a-72145251db0e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4a49f8cf-9789-4520-a27a-72145251db0e', 'volume_size': 1, 'source_volid': '646dfd79-db5a-4882-8549-c7ca501932ea', 'source_volstatus': 'available'} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c3c7f1af-a646-4f6e-acea-4aa92254f778" returned: 0 in 0.636s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-c3c7f1af-a646-4f6e-acea-4aa92254f778" released by "delete_volume" :: held 1.276s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created reservations ['2eccaee2-85e4-4eb2-b599-59ac9f83b54c', '06f67183-6586-42c0-b900-959650d535ca', 'ec06cf1f-2477-4a5b-a485-f0d6deb33cc8', '966dba72-d625-4b79-8457-d24b7c8c11eb'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:18 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd" returned: 0 in 0.656s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.546s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "cinder-quobyte-8227261e-6de9-4f14-ba40-4da0270d3df0-3c7ae135-7ac4-441c-a593-7727f3ea2323" by "_create_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf83fda3-c6bc-418e-ac71-996673dbfcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c30385-210a-4daa-941a-f329abbef5cd', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d33665b-6a44-40e5-993c-c8d2d64b6e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-8227261e-6de9-4f14-ba40-4da0270d3df0-3c7ae135-7ac4-441c-a593-7727f3ea2323" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Creating volume 3c7ae135-7ac4-441c-a593-7727f3ea2323 from snapshot 8227261e-6de9-4f14-ba40-4da0270d3df0 {{(pid=81522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "cinder-quobyte-3c7ae135-7ac4-441c-a593-7727f3ea2323" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:18 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Volume volume-89c30385-210a-4daa-941a-f329abbef5cd (89c30385-210a-4daa-941a-f329abbef5cd): created successfully Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d33665b-6a44-40e5-993c-c8d2d64b6e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:18 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:18 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Flow 'volume_create_manager' (f7e4fc93-1daa-479d-bf4d-86ce26e4bc8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-3c7ae135-7ac4-441c-a593-7727f3ea2323" acquired by "_copy_volume_from_snapshot" :: waited 0.064s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] snapshot: 8227261e-6de9-4f14-ba40-4da0270d3df0, volume: 3c7ae135-7ac4-441c-a593-7727f3ea2323, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:26:18 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-1d5ab775-aabd-4c28-93db-03c829e1d8c0 tempest-CinderUnicodeTest-771148341 None] Created volume successfully. Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[930651bf-d67c-40b9-830f-38cd1b7e0063]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:18 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:18 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 Apr 24 19:26:18 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:19 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.530s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:19 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Deleted volume successfully. Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-bef4e7e8-bec4-406a-bf1a-701d91ab026d tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-c3c7f1af-a646-4f6e-acea-4aa92254f778-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:19 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0" returned: 0 in 0.619s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65551b1-41fb-4e4e-9c33-c44dee2bbe48]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-c8698474-6c8d-4482-b614-248152b94b22-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-c8698474-6c8d-4482-b614-248152b94b22-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=149,cinder:UPDATE=191,cinder:INSERT=40,cinder:DELETE=18 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:26:19 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 Apr 24 19:26:19 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-quobyte-c8698474-6c8d-4482-b614-248152b94b22" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-c8698474-6c8d-4482-b614-248152b94b22" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4ab0f0-a7ac-4d1a-90cf-27dd1cc90442]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:19 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:19 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22 Apr 24 19:26:19 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:20 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9" returned: 0 in 0.647s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:20 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 Apr 24 19:26:20 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:UPDATE=214,cinder:SELECT=145,cinder:INSERT=52,cinder:DELETE=22 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Flow 'volume_create_manager' (e06b2832-9aa3-4899-bacd-999e5960b586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03688e8-3372-49be-8b7a-e4e1a43749ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03688e8-3372-49be-8b7a-e4e1a43749ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1947133885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981166b5-4d43-458d-9477-8c66b9f48a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9734d9e78d4e2a91adc31e9ab8f392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:20Z,use_quota=True,user_id='d7c90d9caa1c4b21a68ed03707e8d8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe014bb-34d3-4b72-9a3c-236038f59ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe014bb-34d3-4b72-9a3c-236038f59ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ab892b-7013-47ad-b5d5-2ba3101a9bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ab892b-7013-47ad-b5d5-2ba3101a9bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981166b5-4d43-458d-9477-8c66b9f48a1d', 'volume_name': 'volume-981166b5-4d43-458d-9477-8c66b9f48a1d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffed6ebb-c12a-4678-aa86-2861aa15f3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffed6ebb-c12a-4678-aa86-2861aa15f3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc69a608-9611-4b22-b9f5-18050e97b7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:20 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Volume 981166b5-4d43-458d-9477-8c66b9f48a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981166b5-4d43-458d-9477-8c66b9f48a1d', 'volume_size': 1} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:20 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22" returned: 0 in 0.769s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:20 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22 Apr 24 19:26:20 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:20 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-c8698474-6c8d-4482-b614-248152b94b22" returned: 0 in 0.573s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:20 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-c8698474-6c8d-4482-b614-248152b94b22" released by "delete_volume" :: held 1.394s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created reservations ['54430a14-7344-417c-946f-38ccdffad1a9', '831ffeef-20a2-4051-84eb-6ac39336f3fb', 'fb7ef0c2-f844-45d8-ad14-c849f1630eca', '1436351a-4928-4b96-aafc-8e16d165ca97'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:21 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:21 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG oslo_service.periodic_task [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81522) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:21 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:21 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:21 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:22 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-quobyte-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:22 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab" acquired by "delete_volume" :: waited 0.034s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:22 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7253e3-4071-4be6-b9f0-5420cd9261f2]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:22 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab Apr 24 19:26:22 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:22 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.224s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e863b3ba-2a92-41a2-8377-cb6aa1ccbd23 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:22 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:22 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.499s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:22 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:22 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Deleted volume successfully. Apr 24 19:26:22 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-eac1481e-cfb0-404a-9524-35f4942c19e9 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-c8698474-6c8d-4482-b614-248152b94b22-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:23 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab" returned: 0 in 1.102s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:23 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:23 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab Apr 24 19:26:23 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:24 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab" returned: 0 in 1.130s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:24 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab" released by "delete_volume" :: held 2.324s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:24 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created reservations ['9b5a6733-54f9-42f7-b127-dd0be0656987', 'b136ecf0-6a6d-4bee-9d7e-945eb7950ceb', '2740b345-4077-40f8-b35a-fc48f543be44', 'd97bcfe9-7165-4d30-a0ce-09e6f36327c5'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:24 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:24 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:24 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:24 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:25 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-9135cebe-8f57-4553-878b-0e1e05c58ca7-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:25 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-9135cebe-8f57-4553-878b-0e1e05c58ca7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:25 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "cinder-quobyte-9135cebe-8f57-4553-878b-0e1e05c58ca7" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:25 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-9135cebe-8f57-4553-878b-0e1e05c58ca7" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:25 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:25 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac10397-d8b7-45cd-84c5-b62ad5c24da3]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:25 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 1.243s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:25 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:26 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Deleted volume successfully. Apr 24 19:26:26 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-886bd6e3-ea61-4888-89ef-ae594dafb654 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-4b9bf752-30ac-4ba8-b7d6-ed533e2765ab-delete_volume" released by "delete_volume" :: held 4.098s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:26 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 Apr 24 19:26:26 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:26 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323" returned: 0 in 6.149s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:26 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86b577-cc9b-4d34-962a-9df3900f7446]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:26 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 Apr 24 19:26:26 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:26 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7" returned: 0 in 0.674s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:26 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:26 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7 Apr 24 19:26:26 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9" returned: 0 in 0.791s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:26:27 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Converted 1024.00 MB image at 166.50 MB/s Apr 24 19:26:27 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 is being set with open permissions: ugo+rw Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:27 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 Apr 24 19:26:27 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-9135cebe-8f57-4553-878b-0e1e05c58ca7" returned: 0 in 0.560s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-quobyte-9135cebe-8f57-4553-878b-0e1e05c58ca7" released by "delete_volume" :: held 1.372s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Created reservations ['6c1c2806-323e-4ddb-8aa6-ed0182c926a5', 'cbe6136f-093b-42bd-bd81-53d74762e06d', '0468caa5-1974-4ef6-8daa-242774667a03', '77b9212e-d683-4cdf-9fc7-7ee0d7a0a06f'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:27 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:27 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323" returned: 0 in 0.524s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-3c7ae135-7ac4-441c-a593-7727f3ea2323" released by "_copy_volume_from_snapshot" :: held 8.839s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-8227261e-6de9-4f14-ba40-4da0270d3df0-3c7ae135-7ac4-441c-a593-7727f3ea2323" released by "_create_volume_from_snapshot" :: held 8.920s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.981s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.089s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:27 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Cloning volume 646dfd79-db5a-4882-8549-c7ca501932ea to volume 4a49f8cf-9789-4520-a27a-72145251db0e Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eacb62-2500-4f8b-bf67-d8741e71e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7ae135-7ac4-441c-a593-7727f3ea2323', 'volume_size': 1, 'snapshot_id': '8227261e-6de9-4f14-ba40-4da0270d3df0'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a092e88-acb9-4075-8278-365bea38448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:27 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Volume volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 (3c7ae135-7ac4-441c-a593-7727f3ea2323): created successfully Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a092e88-acb9-4075-8278-365bea38448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Flow 'volume_create_manager' (70d89260-ff5c-4a6f-b03e-14196d1eefda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Creating offline snapshot 820e0fda-a646-4eef-844e-ad83e94e2f24 of volume 646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:26:27 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ac6d6390-9ab3-4370-a22e-2dae670af092 tempest-SnapshotDependencyTests-214896251 None] Created volume successfully. Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8259ec9-fb90-4d06-90c1-01445c86e319]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:27 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea Apr 24 19:26:27 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.564s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:27 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Deleted volume successfully. Apr 24 19:26:27 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-a1f22a77-74e5-4f43-8b45-9da7dc576236 tempest-CreateVolumesFromSourceVolumeTest-693991096 None] Lock "cinder-9135cebe-8f57-4553-878b-0e1e05c58ca7-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "cinder-8227261e-6de9-4f14-ba40-4da0270d3df0-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-8227261e-6de9-4f14-ba40-4da0270d3df0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "cinder-quobyte-a13a98eb-eaee-429a-ab9e-dfeef66868f9" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-a13a98eb-eaee-429a-ab9e-dfeef66868f9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "cinder-quobyte-8227261e-6de9-4f14-ba40-4da0270d3df0" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-8227261e-6de9-4f14-ba40-4da0270d3df0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Deleting offline snapshot 8227261e-6de9-4f14-ba40-4da0270d3df0 of volume a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] snapshot_file for this snap is: volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:28 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea" returned: 0 in 0.651s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcd549c-a119-4690-a64a-cb7f782fb127]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:28 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:28 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 1G Apr 24 19:26:28 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:28 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 Apr 24 19:26:28 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:29 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 1G" returned: 0 in 0.699s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646dfd79-db5a-4882-8549-c7ca501932ea -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:29 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646dfd79-db5a-4882-8549-c7ca501932ea -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 Apr 24 19:26:29 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:29 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0" returned: 0 in 0.735s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[034de3d6-7d98-4390-931a-4e3e713b5090]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:29 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 Apr 24 19:26:29 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:29 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646dfd79-db5a-4882-8549-c7ca501932ea -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24" returned: 0 in 0.675s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:29 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 is being set with open permissions: ugo+rw Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:29 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 Apr 24 19:26:29 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:29 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9" returned: 0 in 0.721s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:29 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:29 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 Apr 24 19:26:29 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:30 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24" returned: 0 in 0.538s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:30 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.info Apr 24 19:26:30 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:30 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0" returned: 0 in 0.600s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:30 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0 Apr 24 19:26:30 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:30 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.info" returned: 0 in 0.493s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:30 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.info is being set with open permissions: ugo+rw Apr 24 19:26:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:30 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.info Apr 24 19:26:30 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:30 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:30 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9.8227261e-6de9-4f14-ba40-4da0270d3df0" returned: 0 in 0.482s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-8227261e-6de9-4f14-ba40-4da0270d3df0" released by "_delete_snapshot" :: held 2.671s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-a13a98eb-eaee-429a-ab9e-dfeef66868f9" released by "delete_snapshot" :: held 2.702s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Created reservations ['cc2d858c-6382-45fe-9ae8-39cad3e2ec15', 'dba4ff2d-f628-4622-88d8-2c303a9cd925', '67c18b3a-808f-451d-ac91-ac18479a6bfc', '1dbc2f5a-7579-4a4e-b078-3e33c8ec62e4'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:31 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Delete snapshot completed successfully. Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1e96ce7-1f34-4f88-9f15-0b2f86e90797 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-8227261e-6de9-4f14-ba40-4da0270d3df0-delete_snapshot" released by "delete_snapshot" :: held 2.830s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:31 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.info" returned: 0 in 0.492s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-4a49f8cf-9789-4520-a27a-72145251db0e" by "_copy_volume_from_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-4a49f8cf-9789-4520-a27a-72145251db0e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] snapshot: 820e0fda-a646-4eef-844e-ad83e94e2f24, volume: 4a49f8cf-9789-4520-a27a-72145251db0e, {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c6b506-0e3f-4c99-bf8a-1d8c0eccbb6d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:31 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 Apr 24 19:26:31 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "cinder-a13a98eb-eaee-429a-ab9e-dfeef66868f9-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-a13a98eb-eaee-429a-ab9e-dfeef66868f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "cinder-quobyte-a13a98eb-eaee-429a-ab9e-dfeef66868f9" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-a13a98eb-eaee-429a-ab9e-dfeef66868f9" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a976f-eeee-44c1-aff0-e92996f05d14]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:31 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 Apr 24 19:26:31 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:31 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24" returned: 0 in 0.557s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646dfd79-db5a-4882-8549-c7ca501932ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] will copy from snapshot at /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Creating direct copy from snapshot {{(pid=81522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bd787e-5e87-4160-9e5d-e794916921a7]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:31 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:32 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea Apr 24 19:26:32 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:32 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9" returned: 0 in 0.571s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:32 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9 Apr 24 19:26:32 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:32 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea" returned: 0 in 0.588s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG cinder.utils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Path /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e not found in is_blk_device check {{(pid=81522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:32 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e Apr 24 19:26:32 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:32 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-a13a98eb-eaee-429a-ab9e-dfeef66868f9" returned: 0 in 0.479s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-a13a98eb-eaee-429a-ab9e-dfeef66868f9" released by "delete_volume" :: held 1.112s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Created reservations ['a2acfa28-a2e3-4a50-9a5f-654e65c4c498', '11e3db1f-77c2-4a71-8f83-e03a18b8bfdb', 'c892ba21-9cb9-441d-bdf4-693032d1dca8', '174efa1e-fe78-4c5b-9d49-d85fcf3b8afc'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:32 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:32 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:32 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:33 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:33 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.846s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:33 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:33 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Deleted volume successfully. Apr 24 19:26:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-180d3720-41bd-4ba1-900a-3a29e4a55ded tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-a13a98eb-eaee-429a-ab9e-dfeef66868f9-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "cinder-3c7ae135-7ac4-441c-a593-7727f3ea2323-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-3c7ae135-7ac4-441c-a593-7727f3ea2323-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "cinder-quobyte-3c7ae135-7ac4-441c-a593-7727f3ea2323" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:33 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-3c7ae135-7ac4-441c-a593-7727f3ea2323" acquired by "delete_volume" :: waited 0.023s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:34 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9307ed53-3d02-49a2-8acc-77bca6b12ea8]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:34 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:34 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 Apr 24 19:26:34 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:35 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323" returned: 0 in 1.220s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:35 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:35 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323 Apr 24 19:26:35 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:36 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-3c7ae135-7ac4-441c-a593-7727f3ea2323" returned: 0 in 1.080s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:36 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-quobyte-3c7ae135-7ac4-441c-a593-7727f3ea2323" released by "delete_volume" :: held 2.397s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:36 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Created reservations ['af608009-bbad-4465-be04-3ef323924f15', 'f8eeb5ce-f018-4ae1-bd39-ef94d2ff2853', '0509c618-69dd-42f0-beed-ec7a60fc7681', '91e24223-512f-4d3e-b8ad-790ccf3e1e3b'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:36 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:36 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:36 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:36 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:37 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.815s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:37 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:37 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Deleted volume successfully. Apr 24 19:26:37 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c1a13ce6-2029-4166-992f-f7018878b968 tempest-SnapshotDependencyTests-214896251 None] Lock "cinder-3c7ae135-7ac4-441c-a593-7727f3ea2323-delete_volume" released by "delete_volume" :: held 3.658s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:37 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e" returned: 0 in 5.428s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:37 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5b72a3-88d7-4f09-b3ad-e464a946abd3]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:37 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:38 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea Apr 24 19:26:38 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:38 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea" returned: 0 in 0.762s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:38 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Image conversion details: src /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e {{(pid=81522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:26:38 devstack cinder-volume[81522]: INFO cinder.image.image_utils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Converted 1024.00 MB image at 188.61 MB/s Apr 24 19:26:38 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e is being set with open permissions: ugo+rw Apr 24 19:26:38 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:38 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e Apr 24 19:26:38 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:39 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e" returned: 0 in 0.527s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-4a49f8cf-9789-4520-a27a-72145251db0e" released by "_copy_volume_from_snapshot" :: held 7.957s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-820e0fda-a646-4eef-844e-ad83e94e2f24" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-820e0fda-a646-4eef-844e-ad83e94e2f24" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Deleting offline snapshot 820e0fda-a646-4eef-844e-ad83e94e2f24 of volume 646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] snapshot_file for this snap is: volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e93c42-9c82-44ff-bf72-308a3a2c5279]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:39 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 Apr 24 19:26:39 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:39 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24" returned: 0 in 0.564s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646dfd79-db5a-4882-8549-c7ca501932ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc6f7b1-abd1-469e-a895-26131bdf21e1]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:39 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:40 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea Apr 24 19:26:40 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:40 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea" returned: 0 in 0.640s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:40 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:40 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 Apr 24 19:26:40 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:41 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24" returned: 0 in 0.595s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:41 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24 Apr 24 19:26:41 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:41 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea.820e0fda-a646-4eef-844e-ad83e94e2f24" returned: 0 in 0.563s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-820e0fda-a646-4eef-844e-ad83e94e2f24" released by "_delete_snapshot" :: held 2.472s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.212s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.550s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1947133885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981166b5-4d43-458d-9477-8c66b9f48a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9734d9e78d4e2a91adc31e9ab8f392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:20Z,use_quota=True,user_id='d7c90d9caa1c4b21a68ed03707e8d8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf760ab-6f61-4876-bbff-75f43235f295),volume_type_id=cdf760ab-6f61-4876-bbff-75f43235f295)}" {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Creating volume 981166b5-4d43-458d-9477-8c66b9f48a1d {{(pid=81522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Selected osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e as target Quobyte volume. {{(pid=81522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:41 devstack cinder-volume[81522]: INFO cinder.volume.drivers.remotefs [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] casted to osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d 1073741824 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ef0ca3-63b2-4cf3-8873-2a317f8ff409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a49f8cf-9789-4520-a27a-72145251db0e', 'volume_size': 1, 'source_volid': '646dfd79-db5a-4882-8549-c7ca501932ea', 'source_volstatus': 'available'}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcf94db-0d31-4ce9-84ac-b0fcbcf247b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:41 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d 1073741824 Apr 24 19:26:41 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:41 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Volume volume-4a49f8cf-9789-4520-a27a-72145251db0e (4a49f8cf-9789-4520-a27a-72145251db0e): created successfully Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcf94db-0d31-4ce9-84ac-b0fcbcf247b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:41 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Flow 'volume_create_manager' (ee033dfa-ea11-4e99-9b9a-e890adecf3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:41 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-403a2785-1e05-49e5-9f54-4d5f2dd2c878 tempest-VolumeDependencyTests-1595374147 None] Created volume successfully. Apr 24 19:26:42 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d 1073741824" returned: 0 in 0.790s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:42 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d Apr 24 19:26:42 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-646dfd79-db5a-4882-8549-c7ca501932ea-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-646dfd79-db5a-4882-8549-c7ca501932ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-646dfd79-db5a-4882-8549-c7ca501932ea" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:42 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-646dfd79-db5a-4882-8549-c7ca501932ea" acquired by "delete_volume" :: waited 0.018s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:42 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4289984f-fe67-493c-9e80-fafbc5412029]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:42 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:42 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea Apr 24 19:26:42 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:43 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d" returned: 0 in 0.610s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:43 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'} {{(pid=81522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc69a608-9611-4b22-b9f5-18050e97b7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981166b5-4d43-458d-9477-8c66b9f48a1d', 'volume_size': 1}' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abd4de0-61b0-4183-ac85-ec82001b3cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:43 devstack cinder-volume[81522]: INFO cinder.volume.flows.manager.create_volume [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Volume volume-981166b5-4d43-458d-9477-8c66b9f48a1d (981166b5-4d43-458d-9477-8c66b9f48a1d): created successfully Apr 24 19:26:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abd4de0-61b0-4183-ac85-ec82001b3cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81522) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:43 devstack cinder-volume[81522]: DEBUG cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Flow 'volume_create_manager' (e06b2832-9aa3-4899-bacd-999e5960b586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81522) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:43 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-9bb0d64a-39cf-44b4-bf1e-b9fd1c555622 tempest-CinderUnicodeTest-771148341 None] Created volume successfully. Apr 24 19:26:43 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea" returned: 0 in 0.637s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:43 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:43 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea Apr 24 19:26:43 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:44 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-646dfd79-db5a-4882-8549-c7ca501932ea" returned: 0 in 0.494s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-646dfd79-db5a-4882-8549-c7ca501932ea" released by "delete_volume" :: held 1.192s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Created reservations ['9f7c784f-a775-4cfb-b30c-dca1560c05fa', 'df0ad65c-f8d8-4210-b7d8-6d059520f7e0', '5d6006e7-acaa-4cbd-8401-2abeda17a4be', 'a8e2b93c-a36a-453d-9789-25f22a03cef3'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:44 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:44 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:44 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.621s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:44 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Deleted volume successfully. Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Creating offline snapshot 96bf3de2-7e3b-4ec6-828c-de2281303f8c of volume 981166b5-4d43-458d-9477-8c66b9f48a1d {{(pid=81522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-e5e8fa39-2544-4fce-a400-e6c51c8133ca tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-646dfd79-db5a-4882-8549-c7ca501932ea-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8450db-7ac6-4c59-ad99-b8a6dee71842]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:44 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:44 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d Apr 24 19:26:44 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-4a49f8cf-9789-4520-a27a-72145251db0e-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-4a49f8cf-9789-4520-a27a-72145251db0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-4a49f8cf-9789-4520-a27a-72145251db0e" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-4a49f8cf-9789-4520-a27a-72145251db0e" acquired by "delete_volume" :: waited 0.043s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72270f2-94c2-41b4-ab45-7a2b73ed5b33]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:45 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e Apr 24 19:26:45 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:45 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d" returned: 0 in 0.743s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c 1G {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:45 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c 1G Apr 24 19:26:45 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:45 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e" returned: 0 in 0.762s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:45 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:45 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e Apr 24 19:26:45 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:46 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c 1G" returned: 0 in 0.814s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-981166b5-4d43-458d-9477-8c66b9f48a1d -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:46 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-981166b5-4d43-458d-9477-8c66b9f48a1d -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c Apr 24 19:26:46 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:46 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-4a49f8cf-9789-4520-a27a-72145251db0e" returned: 0 in 0.632s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-4a49f8cf-9789-4520-a27a-72145251db0e" released by "delete_volume" :: held 1.441s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Created reservations ['9881e274-757a-4f0c-8d34-0823a1c23e00', '28d393cd-f0e3-4e5b-bf18-6f4f0e08a260', '63cd06bf-06a0-40c2-b1ee-1ece913fd095', 'b2b28352-aa89-43e2-86bc-2d6755fb1a27'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:46 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:46 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:46 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:47 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-981166b5-4d43-458d-9477-8c66b9f48a1d -F qcow2 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c" returned: 0 in 0.665s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:47 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c is being set with open permissions: ugo+rw Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:47 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c Apr 24 19:26:47 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:47 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.566s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:47 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Deleted volume successfully. Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ed34e10a-7904-45a4-9732-8b224c0dd95c tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-4a49f8cf-9789-4520-a27a-72145251db0e-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-e51500a6-2b35-4f55-b945-b04cadeb7b51-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-e51500a6-2b35-4f55-b945-b04cadeb7b51-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "cinder-quobyte-e51500a6-2b35-4f55-b945-b04cadeb7b51" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-e51500a6-2b35-4f55-b945-b04cadeb7b51" acquired by "delete_volume" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[78adabe2-dd0f-4f3a-acd1-bdc0451c19c1]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:47 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 Apr 24 19:26:47 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:47 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c" returned: 0 in 0.608s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:47 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:47 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.info Apr 24 19:26:47 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:48 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51" returned: 0 in 0.570s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:48 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51 Apr 24 19:26:48 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:48 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.info" returned: 0 in 0.457s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:48 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.remotefs [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.info is being set with open permissions: ugo+rw Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.info {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:48 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.info Apr 24 19:26:48 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:48 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-e51500a6-2b35-4f55-b945-b04cadeb7b51" returned: 0 in 0.457s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-quobyte-e51500a6-2b35-4f55-b945-b04cadeb7b51" released by "delete_volume" :: held 1.105s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Created reservations ['79821915-e2e8-45b0-8088-a29c10a0d8d5', 'e078069c-70a5-4d21-bc22-ad0a26ac4ee1', '66bc2b38-cdcb-4c0a-b4e2-e3c28cc3ea1f', '586b8986-96bb-4b60-aeb8-44b17e7fffc1'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:48 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.info" returned: 0 in 0.505s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:48 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:48 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.905s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:48 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:48 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-15c2228c-5a23-4d2d-aa97-4b46bb01ea0b tempest-CinderUnicodeTest-771148341 None] Create snapshot completed successfully Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "cinder-96bf3de2-7e3b-4ec6-828c-de2281303f8c-delete_snapshot" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-96bf3de2-7e3b-4ec6-828c-de2281303f8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "cinder-quobyte-981166b5-4d43-458d-9477-8c66b9f48a1d" by "delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-quobyte-981166b5-4d43-458d-9477-8c66b9f48a1d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "cinder-quobyte-96bf3de2-7e3b-4ec6-828c-de2281303f8c" by "_delete_snapshot" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-quobyte-96bf3de2-7e3b-4ec6-828c-de2281303f8c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Deleting offline snapshot 96bf3de2-7e3b-4ec6-828c-de2281303f8c of volume 981166b5-4d43-458d-9477-8c66b9f48a1d {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] snapshot_file for this snap is: volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c {{(pid=81522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9043ae05-7cb9-40de-bf0b-b20aaf54fb1c]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:49 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.472s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:49 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Deleted volume successfully. Apr 24 19:26:49 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c Apr 24 19:26:49 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-49b9c443-da7a-4f7a-bf6e-0fd3f929a44d tempest-VolumeDependencyTests-1595374147 None] Lock "cinder-e51500a6-2b35-4f55-b945-b04cadeb7b51-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:49 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c" returned: 0 in 0.529s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-981166b5-4d43-458d-9477-8c66b9f48a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8689a2-6a05-48ad-9d80-916c51b3d06b]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:49 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:49 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d Apr 24 19:26:49 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:50 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d" returned: 0 in 0.649s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:50 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:50 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c Apr 24 19:26:50 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:51 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c" returned: 0 in 0.655s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:51 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c Apr 24 19:26:51 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:51 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:51 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d.96bf3de2-7e3b-4ec6-828c-de2281303f8c" returned: 0 in 0.500s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-quobyte-96bf3de2-7e3b-4ec6-828c-de2281303f8c" released by "_delete_snapshot" :: held 2.451s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-quobyte-981166b5-4d43-458d-9477-8c66b9f48a1d" released by "delete_snapshot" :: held 2.479s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:51 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Created reservations ['e9748898-24a4-497f-99d7-0f45d3f32bee', '1b5977f5-36b4-4da4-a252-8e4eaa6d8d47', '5b1716cc-1272-4a10-9c3a-ee40865a6923', '51a1aa8e-896f-4297-b6e4-6c96e2b6d459'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:51 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Delete snapshot completed successfully. Apr 24 19:26:51 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-362de69e-074b-4839-a449-7924ef61d965 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-96bf3de2-7e3b-4ec6-828c-de2281303f8c-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Acquiring lock "cinder-981166b5-4d43-458d-9477-8c66b9f48a1d-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Lock "cinder-981166b5-4d43-458d-9477-8c66b9f48a1d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Acquiring lock "cinder-quobyte-981166b5-4d43-458d-9477-8c66b9f48a1d" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:52 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Lock "cinder-quobyte-981166b5-4d43-458d-9477-8c66b9f48a1d" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:52 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aee8bea-ff5b-42f5-a00c-af9600bb038d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:52 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d Apr 24 19:26:52 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:52 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d" returned: 0 in 0.560s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:52 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:52 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d Apr 24 19:26:52 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:53 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-981166b5-4d43-458d-9477-8c66b9f48a1d" returned: 0 in 0.490s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:53 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Lock "cinder-quobyte-981166b5-4d43-458d-9477-8c66b9f48a1d" released by "delete_volume" :: held 1.132s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:53 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Created reservations ['af0961fa-c9b7-4735-b9e5-5a5938209314', '389d2c95-caa4-43d9-bf15-b005ba32a778', '1328f0d2-e735-4096-8866-4c3c2420cb32', '81e8846f-8afc-483a-a7ae-9a7205f71728'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:53 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:53 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:53 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:53 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:54 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.455s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:54 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:54 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Deleted volume successfully. Apr 24 19:26:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-ac1f4c1a-afff-4e08-bf25-95ce641622bb tempest-CinderUnicodeTest-771148341 None] Lock "cinder-981166b5-4d43-458d-9477-8c66b9f48a1d-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "cinder-89c30385-210a-4daa-941a-f329abbef5cd-delete_volume" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-89c30385-210a-4daa-941a-f329abbef5cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "cinder-quobyte-89c30385-210a-4daa-941a-f329abbef5cd" by "delete_volume" {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:54 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-quobyte-89c30385-210a-4daa-941a-f329abbef5cd" acquired by "delete_volume" :: waited 0.019s {{(pid=81522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:54 devstack cinder-volume[81522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd1e074-ee4c-462d-a841-e19d2d9bd74d]: (4, 'qcow2') {{(pid=82537) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:54 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:54 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd Apr 24 19:26:54 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:55 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd" returned: 0 in 0.510s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:55 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd Apr 24 19:26:55 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:55 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474/volume-89c30385-210a-4daa-941a-f329abbef5cd" returned: 0 in 0.455s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-quobyte-89c30385-210a-4daa-941a-f329abbef5cd" released by "delete_volume" :: held 1.005s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG cinder.quota [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Created reservations ['5e252179-532b-4ad3-81d9-020ac266bf98', '47057f3c-1e99-4ee0-8346-2d0fe18c10a9', '79c951fa-5051-48d1-a30d-ec61d59f4e85', 'a111385a-386a-47a7-b343-6319ba02ee27'] {{(pid=81522) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a04a96d0-7088-410b-a4df-f408a938b70e'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:55 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:55 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474 Apr 24 19:26:55 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:56 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:56 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/36b5b58175e672780d257ef99b9c0474" returned: 0 in 0.435s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:56 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:56 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Deleted volume successfully. Apr 24 19:26:56 devstack cinder-volume[81522]: DEBUG cinder.coordination [None req-c8b34f02-3028-49c8-b0dd-ae507f87f9f8 tempest-CinderUnicodeTest-771148341 None] Lock "cinder-89c30385-210a-4daa-941a-f329abbef5cd-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=81522) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:05 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:SELECT=66,cinder:INSERT=26,cinder:UPDATE=88,cinder:DELETE=5 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:27:06 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writing DB stats cinder:UPDATE=113,cinder:SELECT=71,cinder:INSERT=27,cinder:DELETE=9 {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}